2023-12-06T04:06:23.345 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-06T04:06:23.345 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi --description rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760 --verbose -- /home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760/orig.config.yaml 2023-12-06T04:06:23.378 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T04:06:23.452 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760 branch: wip-yuri6-testing-2023-12-05-0753-pacific description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} email: yweinste@redhat.com first_in_suite: false job_id: '7478760' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri6-testing-2023-12-05-0753-pacific ceph: conf: client: rbd default format: 1 global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri6-testing-2023-12-05-0753-pacific sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 5062 sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: wip-yuri6-testing-2023-12-05-0753-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b targets: smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDcXsvfoj5PjdLWsLsc9l3R4Vo1sdCldN2FJevu7vlm3NZHmL6gJKaKcOLpsRwHkAVrWc6jxrP5Lv18HimfL0/I= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_generic.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-05_19:07:37 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-06T04:06:23.453 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa; will attempt to use it 2023-12-06T04:06:23.453 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks 2023-12-06T04:06:23.453 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-06T04:06:23.455 INFO:teuthology.task.internal:Checking packages... 2023-12-06T04:06:23.479 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd03fca4f35d43f61b4679936aef7bd2f01cced0b' 2023-12-06T04:06:23.479 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-06T04:06:23.479 INFO:teuthology.packaging:ref: None 2023-12-06T04:06:23.479 INFO:teuthology.packaging:tag: None 2023-12-06T04:06:23.479 INFO:teuthology.packaging:branch: wip-yuri6-testing-2023-12-05-0753-pacific 2023-12-06T04:06:23.479 INFO:teuthology.packaging:sha1: d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T04:06:23.479 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri6-testing-2023-12-05-0753-pacific 2023-12-06T04:06:23.703 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-335.gd03fca4f 2023-12-06T04:06:23.703 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-06T04:06:23.711 INFO:teuthology.task.internal:no buildpackages task found 2023-12-06T04:06:23.711 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-06T04:06:23.730 INFO:teuthology.task.internal:Saving configuration 2023-12-06T04:06:23.743 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-06T04:06:23.749 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T04:06:23.775 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 04:01:34.928556', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDcXsvfoj5PjdLWsLsc9l3R4Vo1sdCldN2FJevu7vlm3NZHmL6gJKaKcOLpsRwHkAVrWc6jxrP5Lv18HimfL0/I='} 2023-12-06T04:06:23.775 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-06T04:06:23.781 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-12-06T04:06:23.781 INFO:teuthology.run_tasks:Running task console_log... 2023-12-06T04:06:23.824 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff5103c2ee0>, signals=[15]) 2023-12-06T04:06:23.824 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-06T04:06:23.831 INFO:teuthology.task.internal:Opening connections... 2023-12-06T04:06:23.831 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T04:06:23.833 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T04:06:23.902 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-06T04:06:23.907 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-12-06T04:06:23.972 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-12-06T04:06:23.972 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-12-06T04:06:24.032 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2023-12-06T04:06:24.032 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-06T04:06:24.033 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-06T04:06:24.034 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-12-06T04:06:24.055 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-06T04:06:24.064 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-06T04:06:24.069 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-06T04:06:24.069 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2023-12-06T04:06:24.092 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-06T04:06:24.100 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-06T04:06:24.100 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2023-12-06T04:06:24.158 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-06T04:06:24.193 INFO:teuthology.run_tasks:Running task kernel... 2023-12-06T04:06:24.207 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-06T04:06:24.208 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-06T04:06:24.208 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-06T04:06:24.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T04:06:24.227 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2023-12-06T04:06:24.288 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-489.el8.x86_64 2023-12-06T04:06:24.288 INFO:teuthology.task.kernel:Running kernel on smithi134: 4.18.0-489.el8.x86_64 2023-12-06T04:06:24.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2023-12-06T04:06:27.516 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - AppStream 54 MB/s | 34 MB 00:00 2023-12-06T04:06:40.657 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - BaseOS 8.1 MB/s | 55 MB 00:06 2023-12-06T04:06:48.965 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2023-12-06T04:06:49.516 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 6.9 kB 00:00 2023-12-06T04:06:49.851 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-12-06T04:07:03.017 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 1.2 MB/s | 16 MB 00:13 2023-12-06T04:07:06.875 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 386 kB/s | 24 kB 00:00 2023-12-06T04:07:10.491 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2023-12-06T04:07:10.491 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2023-12-06T04:07:10.773 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 4.18.0-526.el8 baseos 10 M 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 4.18.0-526.el8 baseos 43 M 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 4.18.0-526.el8 baseos 36 M 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:07:10.774 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:07:10.775 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:07:10.775 INFO:teuthology.orchestra.run.smithi134.stdout:Install 3 Packages 2023-12-06T04:07:10.775 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:07:10.775 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 90 M 2023-12-06T04:07:10.775 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 96 M 2023-12-06T04:07:10.775 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:07:11.751 INFO:teuthology.orchestra.run.smithi134.stdout:(1/3): kernel-4.18.0-526.el8.x86_64.rpm 11 MB/s | 10 MB 00:00 2023-12-06T04:07:12.518 INFO:teuthology.orchestra.run.smithi134.stdout:(2/3): kernel-core-4.18.0-526.el8.x86_64.rpm 25 MB/s | 43 MB 00:01 2023-12-06T04:07:12.868 INFO:teuthology.orchestra.run.smithi134.stdout:(3/3): kernel-modules-4.18.0-526.el8.x86_64.rpm 18 MB/s | 36 MB 00:02 2023-12-06T04:07:12.869 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:07:12.869 INFO:teuthology.orchestra.run.smithi134.stdout:Total 43 MB/s | 90 MB 00:02 2023-12-06T04:07:13.553 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:07:13.966 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:07:13.966 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:07:15.202 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:07:15.232 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:07:18.010 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:07:18.493 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-06T04:07:22.073 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 1/3 2023-12-06T04:07:22.646 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-06T04:07:26.078 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 2/3 2023-12-06T04:07:26.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-4.18.0-526.el8.x86_64 3/3 2023-12-06T04:07:48.206 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-4.18.0-526.el8.x86_64 3/3 2023-12-06T04:07:48.230 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-06T04:07:48.572 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-4.18.0-526.el8.x86_64 3/3 2023-12-06T04:07:48.572 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-4.18.0-526.el8.x86_64 1/3 2023-12-06T04:07:48.572 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-4.18.0-526.el8.x86_64 2/3 2023-12-06T04:07:49.366 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-4.18.0-526.el8.x86_64 3/3 2023-12-06T04:07:49.366 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:07:49.366 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:07:49.366 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-4.18.0-526.el8.x86_64 kernel-core-4.18.0-526.el8.x86_64 2023-12-06T04:07:49.366 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-4.18.0-526.el8.x86_64 2023-12-06T04:07:49.366 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:07:49.366 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:07:49.896 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2023-12-06T04:07:50.113 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-06T04:07:50.114 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-06T04:07:50.114 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-526.el8.x86_64 2023-12-06T04:07:50.114 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-06T04:07:50.114 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-06T04:07:50.114 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-06T04:07:50.114 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2023-12-06T04:07:50.114 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2023-12-06T04:07:50.324 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-526.el8.x86_64 2023-12-06T04:07:50.324 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-526.el8.x86_64 2023-12-06T04:07:50.324 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.02 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 129.el8 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Group : System Environment/Base 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 9265586 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-12-06T04:07:50.358 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : kbuilder.bsys.centos.org 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:Relocations : (not relocatable) 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : CentOS BuildSystem 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:07:50.359 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2023-12-06T04:07:50.360 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-06T04:07:50.360 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 4.18.0-526.el8.x86_64 2023-12-06T04:07:50.360 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-06T04:07:51.607 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2023-12-06T04:07:53.533 INFO:teuthology.orchestra.run.smithi134.stderr:done 2023-12-06T04:07:53.535 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-12-06T04:07:53.560 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.uHztBTJ8Ts 2023-12-06T04:07:53.560 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uHztBTJ8Ts 2023-12-06T04:07:53.634 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.uHztBTJ8Ts 2023-12-06T04:07:53.777 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.uHztBTJ8Ts is 6KB 2023-12-06T04:07:53.824 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.uHztBTJ8Ts 2023-12-06T04:07:53.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2023-12-06T04:07:53.914 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-12-06T04:07:53.914 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-12-06T04:07:53.914 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-12-06T04:07:53.914 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64.conf 2023-12-06T04:07:53.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-526.el8.x86_64 2023-12-06T04:07:54.093 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2023-12-06T04:08:24.122 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-06T04:08:24.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-06T04:08:24.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T04:09:24.183 DEBUG:teuthology.orchestra.remote:timed out 2023-12-06T04:09:33.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-06T04:09:33.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T04:09:33.511 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-12-06T04:09:33.865 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-06T04:09:33.866 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-526.el8.x86_64"... 2023-12-06T04:09:33.866 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2023-12-06T04:09:33.883 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-526.el8.x86_64 2023-12-06T04:09:33.883 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-526.el8.x86_64 vs 4.18.0-526.el8.x86_64 2023-12-06T04:09:33.883 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-06T04:09:33.883 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-06T04:09:34.884 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-06T04:09:34.884 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-06T04:09:34.955 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2023-12-06T04:09:34.972 DEBUG:teuthology.parallel:result is None 2023-12-06T04:09:34.972 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-06T04:09:34.979 INFO:teuthology.task.internal:Creating test directory... 2023-12-06T04:09:34.979 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-06T04:09:34.997 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-06T04:09:35.005 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-06T04:09:35.016 INFO:teuthology.task.internal:Creating archive directory... 2023-12-06T04:09:35.016 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-06T04:09:35.092 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-06T04:09:35.100 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-06T04:09:35.100 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-06T04:09:35.176 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-06T04:09:35.186 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-06T04:09:35.187 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-06T04:09:35.195 INFO:teuthology.task.internal:Configuring sudo... 2023-12-06T04:09:35.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-06T04:09:35.259 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-06T04:09:35.269 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-06T04:09:35.269 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-06T04:09:35.322 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-06T04:09:35.410 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-06T04:09:35.464 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-06T04:09:35.552 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-06T04:09:35.598 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:09:35.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-06T04:09:35.668 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2023-12-06T04:09:35.767 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-06T04:09:36.029 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-06T04:09:36.037 INFO:teuthology.task.internal:Starting timer... 2023-12-06T04:09:36.037 INFO:teuthology.run_tasks:Running task pcp... 2023-12-06T04:09:36.053 INFO:teuthology.run_tasks:Running task selinux... 2023-12-06T04:09:36.067 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-06T04:09:36.067 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2023-12-06T04:09:36.171 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2023-12-06T04:09:36.173 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-06T04:09:36.173 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2023-12-06T04:09:36.258 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2023-12-06T04:09:36.258 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2023-12-06T04:09:36.258 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-06T04:09:36.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T04:09:36.285 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-06T04:09:36.285 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2023-12-06T04:09:36.355 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-06T04:09:36.366 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-06T04:09:36.366 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-06T04:09:36.388 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-06T04:09:36.390 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-06T04:17:16.645 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2023-12-06T04:17:16.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-06T04:17:16.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-06T04:17:16.719 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-12-06T04:17:16.788 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-12-06T04:17:16.789 INFO:teuthology.run_tasks:Running task clock... 2023-12-06T04:17:16.799 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-06T04:17:16.799 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-06T04:17:16.799 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-06T04:17:16.860 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-06T04:17:16.875 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-06T04:17:16.941 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2023-12-06T04:17:16.952 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2023-12-06T04:17:16.966 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-06T04:17:16.979 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-06T04:17:17.048 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2023-12-06T04:17:17.053 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-06T04:17:17.053 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2023-12-06T04:17:17.053 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T04:17:17.053 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T04:17:17.053 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T04:17:17.053 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T04:17:17.053 INFO:teuthology.run_tasks:Running task install... 2023-12-06T04:17:17.061 DEBUG:teuthology.task.install:project ceph 2023-12-06T04:17:17.061 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'}} 2023-12-06T04:17:17.062 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'} 2023-12-06T04:17:17.062 INFO:teuthology.task.install:Using flavor: default 2023-12-06T04:17:17.069 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-06T04:17:17.069 INFO:teuthology.task.install:extra packages: [] 2023-12-06T04:17:17.070 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b', 'tag': None, 'wait_for_package': False} 2023-12-06T04:17:17.070 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T04:17:17.213 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-12-05-0753-pacific/d03fca4f35d43f61b4679936aef7bd2f01cced0b/centos/8/flavors/default/ 2023-12-06T04:17:17.213 INFO:teuthology.task.install.rpm:Package version is 16.2.14-335.gd03fca4f 2023-12-06T04:17:17.328 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-12-05-0753-pacific/d03fca4f35d43f61b4679936aef7bd2f01cced0b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-12-05-0753-pacific/d03fca4f35d43f61b4679936aef7bd2f01cced0b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri6-testing-2023-12-05-0753-pacific/d03fca4f35d43f61b4679936aef7bd2f01cced0b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-06T04:17:17.328 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:17:17.328 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-06T04:17:17.359 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-12-06T04:17:17.360 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d03fca4f35d43f61b4679936aef7bd2f01cced0b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-06T04:17:17.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-06T04:17:17.505 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-06T04:17:17.571 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2023-12-06T04:17:17.573 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2023-12-06T04:17:17.844 INFO:teuthology.orchestra.run.smithi134.stdout:76 files removed 2023-12-06T04:17:17.872 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2023-12-06T04:17:18.614 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 227 kB/s | 76 kB 00:00 2023-12-06T04:17:19.048 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 39 kB/s | 15 kB 00:00 2023-12-06T04:17:19.340 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 5.5 kB/s | 1.4 kB 00:00 2023-12-06T04:17:21.515 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - AppStream 16 MB/s | 34 MB 00:02 2023-12-06T04:17:33.782 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - BaseOS 9.1 MB/s | 55 MB 00:06 2023-12-06T04:17:42.166 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2023-12-06T04:17:42.741 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 6.9 kB 00:00 2023-12-06T04:17:44.384 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - PowerTools 4.4 MB/s | 6.6 MB 00:01 2023-12-06T04:17:45.851 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-12-06T04:17:46.729 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-12-06T04:17:50.594 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 443 kB/s | 24 kB 00:00 2023-12-06T04:17:55.196 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:17:55.199 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:17:55.199 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-06T04:17:55.199 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:17:55.199 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:17:55.199 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 12 M 2023-12-06T04:17:55.199 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2023-12-06T04:17:55.199 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 3.7 M 2023-12-06T04:17:55.199 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 4.2 M 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 6.1 M 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 24 M 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 26 k 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 824 k 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 493 k 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 3.8 M 2023-12-06T04:17:55.200 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 45 k 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 99 k 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 215 k 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 389 k 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 369 k 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 114 k 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout:Install 21 Packages 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2023-12-06T04:17:55.201 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:17:55.202 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 57 M 2023-12-06T04:17:55.202 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:17:58.220 INFO:teuthology.orchestra.run.smithi134.stdout:(1/23): ceph-base-16.2.14-335.gd03fca4f.el8.x86 2.3 MB/s | 6.1 MB 00:02 2023-12-06T04:17:58.287 INFO:teuthology.orchestra.run.smithi134.stdout:(2/23): ceph-selinux-16.2.14-335.gd03fca4f.el8. 386 kB/s | 26 kB 00:00 2023-12-06T04:17:58.529 INFO:teuthology.orchestra.run.smithi134.stdout:(3/23): libcephfs2-16.2.14-335.gd03fca4f.el8.x8 3.3 MB/s | 824 kB 00:00 2023-12-06T04:17:58.737 INFO:teuthology.orchestra.run.smithi134.stdout:(4/23): libradosstriper1-16.2.14-335.gd03fca4f. 2.3 MB/s | 493 kB 00:00 2023-12-06T04:17:59.438 INFO:teuthology.orchestra.run.smithi134.stdout:(5/23): ceph-common-16.2.14-335.gd03fca4f.el8.x 6.3 MB/s | 24 MB 00:03 2023-12-06T04:17:59.504 INFO:teuthology.orchestra.run.smithi134.stdout:(6/23): python3-ceph-argparse-16.2.14-335.gd03f 679 kB/s | 45 kB 00:00 2023-12-06T04:17:59.563 INFO:teuthology.orchestra.run.smithi134.stdout:(7/23): python3-ceph-common-16.2.14-335.gd03fca 1.7 MB/s | 99 kB 00:00 2023-12-06T04:17:59.655 INFO:teuthology.orchestra.run.smithi134.stdout:(8/23): librgw2-16.2.14-335.gd03fca4f.el8.x86_6 4.1 MB/s | 3.8 MB 00:00 2023-12-06T04:17:59.681 INFO:teuthology.orchestra.run.smithi134.stdout:(9/23): python3-cephfs-16.2.14-335.gd03fca4f.el 1.8 MB/s | 215 kB 00:00 2023-12-06T04:17:59.748 INFO:teuthology.orchestra.run.smithi134.stdout:(10/23): python3-rbd-16.2.14-335.gd03fca4f.el8. 5.4 MB/s | 369 kB 00:00 2023-12-06T04:17:59.773 INFO:teuthology.orchestra.run.smithi134.stdout:(11/23): python3-rados-16.2.14-335.gd03fca4f.el 3.3 MB/s | 389 kB 00:00 2023-12-06T04:17:59.806 INFO:teuthology.orchestra.run.smithi134.stdout:(12/23): python3-rgw-16.2.14-335.gd03fca4f.el8. 1.9 MB/s | 114 kB 00:00 2023-12-06T04:18:00.248 INFO:teuthology.orchestra.run.smithi134.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 745 kB/s | 354 kB 00:00 2023-12-06T04:18:00.290 INFO:teuthology.orchestra.run.smithi134.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 537 kB/s | 259 kB 00:00 2023-12-06T04:18:00.349 INFO:teuthology.orchestra.run.smithi134.stdout:(15/23): python3-prettytable-0.7.2-14.el8.noarc 439 kB/s | 44 kB 00:00 2023-12-06T04:18:00.374 INFO:teuthology.orchestra.run.smithi134.stdout:(16/23): librabbitmq-0.9.0-4.el8.x86_64.rpm 562 kB/s | 47 kB 00:00 2023-12-06T04:18:00.774 INFO:teuthology.orchestra.run.smithi134.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 452 kB/s | 181 kB 00:00 2023-12-06T04:18:00.841 INFO:teuthology.orchestra.run.smithi134.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 622 kB/s | 306 kB 00:00 2023-12-06T04:18:00.875 INFO:teuthology.orchestra.run.smithi134.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 587 kB/s | 59 kB 00:00 2023-12-06T04:18:00.967 INFO:teuthology.orchestra.run.smithi134.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 600 kB/s | 75 kB 00:00 2023-12-06T04:18:01.501 INFO:teuthology.orchestra.run.smithi134.stdout:(21/23): librbd1-16.2.14-335.gd03fca4f.el8.x86_ 7.8 MB/s | 4.2 MB 00:00 2023-12-06T04:18:01.676 INFO:teuthology.orchestra.run.smithi134.stdout:(22/23): librados2-16.2.14-335.gd03fca4f.el8.x8 4.7 MB/s | 3.7 MB 00:00 2023-12-06T04:18:03.467 INFO:teuthology.orchestra.run.smithi134.stdout:(23/23): ceph-radosgw-16.2.14-335.gd03fca4f.el8 1.5 MB/s | 12 MB 00:07 2023-12-06T04:18:03.470 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:18:03.470 INFO:teuthology.orchestra.run.smithi134.stdout:Total 6.9 MB/s | 57 MB 00:08 2023-12-06T04:18:03.512 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:18:03.559 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:18:03.559 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:18:03.906 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:18:03.910 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:18:04.968 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:18:05.175 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-12-06T04:18:05.336 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-06T04:18:05.715 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-12-06T04:18:05.903 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 3/25 2023-12-06T04:18:06.009 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 3/25 2023-12-06T04:18:06.250 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:16.2.14-335.gd03fca4f.el8.x86_64 4/25 2023-12-06T04:18:06.420 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 5/25 2023-12-06T04:18:06.850 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 5/25 2023-12-06T04:18:07.011 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 6/25 2023-12-06T04:18:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 6/25 2023-12-06T04:18:07.301 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/25 2023-12-06T04:18:07.453 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/25 2023-12-06T04:18:07.830 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/25 2023-12-06T04:18:07.994 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:16.2.14-335.gd03fca4f.el8.x86_64 9/25 2023-12-06T04:18:08.059 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:16.2.14-335.gd03fca4f.el8.x86_64 9/25 2023-12-06T04:18:08.500 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2023-12-06T04:18:08.658 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:16.2.14-335.gd03fca4f.el8. 11/25 2023-12-06T04:18:08.823 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:16.2.14-335.gd03fca4f.el8.x86_64 12/25 2023-12-06T04:18:09.054 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:16.2.14-335.gd03fca4f.el8.x86_64 13/25 2023-12-06T04:18:09.262 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:16.2.14-335.gd03fca4f.el8.x86_64 14/25 2023-12-06T04:18:09.394 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:16.2.14-335.gd03fca4f.el8.x86_6 15/25 2023-12-06T04:18:09.467 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:16.2.14-335.gd03fca4f.el8.x86_6 15/25 2023-12-06T04:18:09.704 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-12-06T04:18:09.895 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-12-06T04:18:10.050 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-12-06T04:18:10.195 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:16.2.14-335.gd03fca4f.el8.x8 19/25 2023-12-06T04:18:12.679 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 20/25 2023-12-06T04:18:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 20/25 2023-12-06T04:18:13.606 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 20/25 2023-12-06T04:18:14.145 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 21/25 2023-12-06T04:18:14.253 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 21/25 2023-12-06T04:18:14.394 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:16.2.14-335.gd03fca4f.el8.x86_64 22/25 2023-12-06T04:18:32.569 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:16.2.14-335.gd03fca4f.el8.x86_64 22/25 2023-12-06T04:18:32.569 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2023-12-06T04:18:32.569 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2023-12-06T04:18:32.569 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2023-12-06T04:18:32.569 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /run 2023-12-06T04:18:32.569 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2023-12-06T04:18:32.570 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2023-12-06T04:18:32.570 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2023-12-06T04:18:32.570 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2023-12-06T04:18:32.570 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2023-12-06T04:18:32.570 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:18:33.726 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:16.2.14-335.gd03fca4f.el8.x86_64 23/25 2023-12-06T04:18:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:16.2.14-335.gd03fca4f.el8.x86_64 23/25 2023-12-06T04:18:33.788 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-06T04:18:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-12-06T04:18:34.001 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T04:18:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T04:18:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 1/25 2023-12-06T04:18:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 2/25 2023-12-06T04:18:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:16.2.14-335.gd03fca4f.el8.x86_64 3/25 2023-12-06T04:18:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:16.2.14-335.gd03fca4f.el8.x86_64 4/25 2023-12-06T04:18:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 5/25 2023-12-06T04:18:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:16.2.14-335.gd03fca4f.el8.x86_6 6/25 2023-12-06T04:18:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:16.2.14-335.gd03fca4f.el8.x86_64 7/25 2023-12-06T04:18:34.729 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:16.2.14-335.gd03fca4f.el8. 8/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:16.2.14-335.gd03fca4f.el8.x8 9/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:16.2.14-335.gd03fca4f.el8.x86_64 10/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:16.2.14-335.gd03fca4f.el8.x86_64 11/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:16.2.14-335.gd03fca4f.el8.x86_64 12/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:16.2.14-335.gd03fca4f.el8.x86_64 13/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 17/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2023-12-06T04:18:34.730 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 22/25 2023-12-06T04:18:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-12-06T04:18:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 24/25 2023-12-06T04:18:35.959 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-12-06T04:18:35.959 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: leveldb-1.22-1.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-06T04:18:35.960 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:18:35.961 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:18:36.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2023-12-06T04:18:37.067 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:47 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:18:38.742 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:18:38.743 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:18:38.743 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-06T04:18:38.743 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:18:38.743 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:18:38.743 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 52 M 2023-12-06T04:18:38.743 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-06T04:18:38.743 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2023-12-06T04:18:38.743 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 174 k 2023-12-06T04:18:38.744 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-12-06T04:18:38.744 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-12-06T04:18:38.744 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-12-06T04:18:38.744 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:18:38.744 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:18:38.744 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:18:38.744 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2023-12-06T04:18:38.744 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:18:38.745 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 53 M 2023-12-06T04:18:38.745 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 196 M 2023-12-06T04:18:38.745 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:18:39.220 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 470 kB/s | 203 kB 00:00 2023-12-06T04:18:39.236 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): libcephsqlite-16.2.14-335.gd03fca4f.el8. 387 kB/s | 174 kB 00:00 2023-12-06T04:18:39.329 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-12-06T04:18:39.429 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 707 kB/s | 71 kB 00:00 2023-12-06T04:18:39.737 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 645 kB/s | 323 kB 00:00 2023-12-06T04:18:42.729 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): ceph-test-16.2.14-335.gd03fca4f.el8.x86_ 13 MB/s | 52 MB 00:03 2023-12-06T04:18:42.731 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:18:42.731 INFO:teuthology.orchestra.run.smithi134.stdout:Total 13 MB/s | 53 MB 00:03 2023-12-06T04:18:42.774 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:18:42.795 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:18:42.795 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:18:43.124 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:18:43.127 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:18:43.618 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:18:43.833 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-12-06T04:18:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-12-06T04:18:44.163 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-06T04:18:44.242 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-12-06T04:18:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2023-12-06T04:18:44.572 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:16.2.14-335.gd03fca4f.el8.x86_64 5/6 2023-12-06T04:18:49.159 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:16.2.14-335.gd03fca4f.el8.x86_64 5/6 2023-12-06T04:18:49.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:16.2.14-335.gd03fca4f.el8.x86_64 6/6 2023-12-06T04:18:49.682 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:16.2.14-335.gd03fca4f.el8.x86_64 6/6 2023-12-06T04:18:49.682 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:16.2.14-335.gd03fca4f.el8.x86_64 1/6 2023-12-06T04:18:49.682 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:16.2.14-335.gd03fca4f.el8.x86_64 2/6 2023-12-06T04:18:49.682 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2023-12-06T04:18:49.682 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-12-06T04:18:49.682 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-12-06T04:18:50.376 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-12-06T04:18:50.376 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:18:50.376 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:18:50.376 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:50.377 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.6-8.el8.x86_64 2023-12-06T04:18:50.377 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:18:50.377 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-06T04:18:50.377 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-06T04:18:50.377 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-06T04:18:50.377 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:18:50.377 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:18:50.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2023-12-06T04:18:51.462 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:01 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:18:53.147 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 6.4 k 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 2.4 M 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 1.6 M 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 245 k 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 5.0 M 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 18 M 2023-12-06T04:18:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-12-06T04:18:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout:Install 32 Packages 2023-12-06T04:18:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:18:53.154 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 31 M 2023-12-06T04:18:53.154 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 101 M 2023-12-06T04:18:53.154 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:18:53.862 INFO:teuthology.orchestra.run.smithi134.stdout:(1/32): ceph-16.2.14-335.gd03fca4f.el8.x86_64.r 22 kB/s | 6.4 kB 00:00 2023-12-06T04:18:54.170 INFO:teuthology.orchestra.run.smithi134.stdout:(2/32): ceph-mgr-16.2.14-335.gd03fca4f.el8.x86_ 2.7 MB/s | 1.6 MB 00:00 2023-12-06T04:18:55.296 INFO:teuthology.orchestra.run.smithi134.stdout:(3/32): ceph-mds-16.2.14-335.gd03fca4f.el8.x86_ 1.4 MB/s | 2.4 MB 00:01 2023-12-06T04:18:55.454 INFO:teuthology.orchestra.run.smithi134.stdout:(4/32): ceph-mgr-modules-core-16.2.14-335.gd03f 1.5 MB/s | 245 kB 00:00 2023-12-06T04:18:55.855 INFO:teuthology.orchestra.run.smithi134.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 393 kB/s | 157 kB 00:00 2023-12-06T04:18:56.049 INFO:teuthology.orchestra.run.smithi134.stdout:(6/32): ceph-osd-16.2.14-335.gd03fca4f.el8.x86_ 9.8 MB/s | 18 MB 00:01 2023-12-06T04:18:56.080 INFO:teuthology.orchestra.run.smithi134.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 172 kB/s | 39 kB 00:00 2023-12-06T04:18:56.181 INFO:teuthology.orchestra.run.smithi134.stdout:(8/32): python3-pytz-2017.2-11.el8.noarch.rpm 570 kB/s | 57 kB 00:00 2023-12-06T04:18:56.439 INFO:teuthology.orchestra.run.smithi134.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 1.7 MB/s | 457 kB 00:00 2023-12-06T04:18:56.464 INFO:teuthology.orchestra.run.smithi134.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 250 kB/s | 103 kB 00:00 2023-12-06T04:18:56.540 INFO:teuthology.orchestra.run.smithi134.stdout:(11/32): ceph-mon-16.2.14-335.gd03fca4f.el8.x86 1.9 MB/s | 5.0 MB 00:02 2023-12-06T04:18:56.685 INFO:teuthology.orchestra.run.smithi134.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 753 kB/s | 109 kB 00:00 2023-12-06T04:18:56.715 INFO:teuthology.orchestra.run.smithi134.stdout:(13/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 902 kB/s | 249 kB 00:00 2023-12-06T04:18:56.791 INFO:teuthology.orchestra.run.smithi134.stdout:(14/32): python3-cryptography-3.2.1-6.el8.x86_6 1.9 MB/s | 641 kB 00:00 2023-12-06T04:18:56.816 INFO:teuthology.orchestra.run.smithi134.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 334 kB/s | 44 kB 00:00 2023-12-06T04:18:56.858 INFO:teuthology.orchestra.run.smithi134.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.3 MB/s | 185 kB 00:00 2023-12-06T04:18:56.900 INFO:teuthology.orchestra.run.smithi134.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 267 kB/s | 11 kB 00:00 2023-12-06T04:18:56.942 INFO:teuthology.orchestra.run.smithi134.stdout:(18/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.1 MB/s | 173 kB 00:00 2023-12-06T04:18:56.967 INFO:teuthology.orchestra.run.smithi134.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 263 kB/s | 18 kB 00:00 2023-12-06T04:18:56.992 INFO:teuthology.orchestra.run.smithi134.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 969 kB/s | 49 kB 00:00 2023-12-06T04:18:57.018 INFO:teuthology.orchestra.run.smithi134.stdout:(21/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.9 MB/s | 384 kB 00:00 2023-12-06T04:18:57.043 INFO:teuthology.orchestra.run.smithi134.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 780 kB/s | 59 kB 00:00 2023-12-06T04:18:57.068 INFO:teuthology.orchestra.run.smithi134.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2023-12-06T04:18:57.093 INFO:teuthology.orchestra.run.smithi134.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 374 kB/s | 19 kB 00:00 2023-12-06T04:18:57.119 INFO:teuthology.orchestra.run.smithi134.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 477 kB/s | 24 kB 00:00 2023-12-06T04:18:57.144 INFO:teuthology.orchestra.run.smithi134.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 582 kB/s | 29 kB 00:00 2023-12-06T04:18:57.169 INFO:teuthology.orchestra.run.smithi134.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 550 kB/s | 27 kB 00:00 2023-12-06T04:18:57.194 INFO:teuthology.orchestra.run.smithi134.stdout:(28/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-12-06T04:18:57.253 INFO:teuthology.orchestra.run.smithi134.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 2.3 MB/s | 255 kB 00:00 2023-12-06T04:18:57.278 INFO:teuthology.orchestra.run.smithi134.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.0 MB/s | 85 kB 00:00 2023-12-06T04:18:57.303 INFO:teuthology.orchestra.run.smithi134.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.8 MB/s | 251 kB 00:00 2023-12-06T04:18:57.354 INFO:teuthology.orchestra.run.smithi134.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 305 kB/s | 23 kB 00:00 2023-12-06T04:18:57.355 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:18:57.355 INFO:teuthology.orchestra.run.smithi134.stdout:Total 7.5 MB/s | 31 MB 00:04 2023-12-06T04:18:57.442 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:18:57.480 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:18:57.480 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:18:57.778 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:18:57.781 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:18:58.921 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:18:59.107 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-12-06T04:18:59.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-12-06T04:18:59.577 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-12-06T04:18:59.847 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2023-12-06T04:19:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-12-06T04:19:00.229 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-12-06T04:19:00.381 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-12-06T04:19:00.625 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-12-06T04:19:00.825 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-12-06T04:19:01.063 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-12-06T04:19:01.300 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-12-06T04:19:01.507 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-12-06T04:19:01.895 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2023-12-06T04:19:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 14/32 2023-12-06T04:19:02.327 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-12-06T04:19:02.592 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-12-06T04:19:02.786 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-06T04:19:03.085 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-12-06T04:19:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-12-06T04:19:03.479 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2023-12-06T04:19:03.657 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-12-06T04:19:03.948 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-12-06T04:19:04.147 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-12-06T04:19:04.330 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-12-06T04:19:04.671 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2023-12-06T04:19:04.972 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-12-06T04:19:05.356 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:16.2.14-335.gd03fca4f.el8. 27/32 2023-12-06T04:19:05.537 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 28/32 2023-12-06T04:19:07.021 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 28/32 2023-12-06T04:19:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:16.2.14-335.gd03fca4f.el8.x86_64 29/32 2023-12-06T04:19:07.606 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:16.2.14-335.gd03fca4f.el8.x86_64 29/32 2023-12-06T04:19:08.027 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:16.2.14-335.gd03fca4f.el8.x86_64 30/32 2023-12-06T04:19:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:16.2.14-335.gd03fca4f.el8.x86_64 30/32 2023-12-06T04:19:08.410 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:16.2.14-335.gd03fca4f.el8.x86_64 31/32 2023-12-06T04:19:08.428 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:16.2.14-335.gd03fca4f.el8.x86_64 31/32 2023-12-06T04:19:08.559 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:16.2.14-335.gd03fca4f.el8.x86_64 32/32 2023-12-06T04:19:08.959 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:16.2.14-335.gd03fca4f.el8.x86_64 32/32 2023-12-06T04:19:08.959 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:16.2.14-335.gd03fca4f.el8.x86_64 1/32 2023-12-06T04:19:08.959 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:16.2.14-335.gd03fca4f.el8.x86_64 2/32 2023-12-06T04:19:08.959 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 3/32 2023-12-06T04:19:08.959 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:16.2.14-335.gd03fca4f.el8.x86_64 4/32 2023-12-06T04:19:08.959 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:16.2.14-335.gd03fca4f.el8.x86_64 5/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:16.2.14-335.gd03fca4f.el8. 6/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 13/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-12-06T04:19:08.960 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-12-06T04:19:08.961 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-12-06T04:19:08.961 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-12-06T04:19:08.961 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-12-06T04:19:08.961 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-12-06T04:19:08.961 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-12-06T04:19:08.961 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-12-06T04:19:08.961 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-12-06T04:19:08.961 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-12-06T04:19:08.962 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-12-06T04:19:08.962 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2023-12-06T04:19:08.962 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-12-06T04:19:08.962 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-12-06T04:19:10.153 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-06T04:19:10.154 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-2.6-1.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-06T04:19:10.155 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:10.156 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:19:10.384 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2023-12-06T04:19:11.235 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:21 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:19:12.677 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T04:19:12.898 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:19:12.899 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-06T04:19:12.900 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:19:13.002 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2023-12-06T04:19:13.853 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:23 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:19:15.530 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:19:15.530 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-06T04:19:15.530 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:15.531 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:19:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 85 k 2023-12-06T04:19:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:15.531 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:19:15.531 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:15.531 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-06T04:19:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:15.532 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 85 k 2023-12-06T04:19:15.532 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 352 k 2023-12-06T04:19:15.532 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:19:15.926 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-16.2.14-335.gd03fca4f.el8.noarch.rpm 216 kB/s | 85 kB 00:00 2023-12-06T04:19:15.927 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:19:15.927 INFO:teuthology.orchestra.run.smithi134.stdout:Total 215 kB/s | 85 kB 00:00 2023-12-06T04:19:15.927 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:19:15.934 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:19:15.934 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:19:15.936 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:19:15.939 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:19:15.980 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:19:16.434 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/1 2023-12-06T04:19:16.606 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/1 2023-12-06T04:19:16.830 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/1 2023-12-06T04:19:17.514 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/1 2023-12-06T04:19:17.514 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:17.514 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:19:17.514 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T04:19:17.514 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:17.514 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:19:17.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2023-12-06T04:19:18.578 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:28 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:19:20.268 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:19:20.269 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 161 k 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:20.270 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 161 k 2023-12-06T04:19:20.271 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 470 k 2023-12-06T04:19:20.271 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:19:20.572 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-16.2.14-335.gd03fca 534 kB/s | 161 kB 00:00 2023-12-06T04:19:20.572 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:19:20.573 INFO:teuthology.orchestra.run.smithi134.stdout:Total 532 kB/s | 161 kB 00:00 2023-12-06T04:19:20.573 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:19:20.583 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:19:20.583 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:19:20.630 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:19:20.633 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:19:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:19:20.916 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:16.2.14-335.gd03fca4f. 1/1 2023-12-06T04:19:21.314 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.14-335.gd03fca4f. 1/1 2023-12-06T04:19:22.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:16.2.14-335.gd03fca4f. 1/1 2023-12-06T04:19:22.004 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:22.004 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:19:22.004 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:19:22.004 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:22.005 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:19:22.242 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2023-12-06T04:19:23.105 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:33 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:19:24.547 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T04:19:24.768 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:19:24.769 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-06T04:19:24.770 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:19:24.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2023-12-06T04:19:25.718 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:35 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:19:27.406 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:19:27.407 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 3.1 M 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 24 k 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 15 k 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:27.408 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2023-12-06T04:19:27.409 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:27.409 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.4 M 2023-12-06T04:19:27.409 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 22 M 2023-12-06T04:19:27.409 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:19:27.907 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): ceph-grafana-dashboards-16.2.14-335.gd03 181 kB/s | 24 kB 00:00 2023-12-06T04:19:27.924 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): ceph-prometheus-alerts-16.2.14-335.gd03f 98 kB/s | 15 kB 00:00 2023-12-06T04:19:27.999 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 463 kB/s | 43 kB 00:00 2023-12-06T04:19:28.158 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): ceph-mgr-dashboard-16.2.14-335.gd03fca4f 8.1 MB/s | 3.1 MB 00:00 2023-12-06T04:19:28.308 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 88 kB/s | 34 kB 00:00 2023-12-06T04:19:28.658 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 298 kB/s | 196 kB 00:00 2023-12-06T04:19:28.659 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:19:28.660 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.7 MB/s | 3.4 MB 00:01 2023-12-06T04:19:28.671 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:19:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:19:28.681 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:19:28.836 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:19:28.839 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:19:29.127 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:19:29.320 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-12-06T04:19:29.574 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-12-06T04:19:29.742 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-12-06T04:19:29.871 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:16.2.14-335.gd03fca4f.el8.n 4/6 2023-12-06T04:19:30.868 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:16.2.14-335.gd03fca4f.el8. 5/6 2023-12-06T04:19:31.132 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:16.2.14-335.gd03fca4f.el8.noarc 6/6 2023-12-06T04:19:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.14-335.gd03fca4f.el8.noarc 6/6 2023-12-06T04:19:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:16.2.14-335.gd03fca4f.el8. 1/6 2023-12-06T04:19:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:16.2.14-335.gd03fca4f.el8.noarc 2/6 2023-12-06T04:19:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:16.2.14-335.gd03fca4f.el8.n 3/6 2023-12-06T04:19:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-12-06T04:19:31.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:32.100 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:19:32.222 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2023-12-06T04:19:33.080 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:43 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:19:34.770 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:19:34.771 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================================ 2023-12-06T04:19:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-06T04:19:34.771 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================================ 2023-12-06T04:19:34.771 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:19:34.771 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 8.6 M 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================================ 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout:Install 8 Packages 2023-12-06T04:19:34.772 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:34.773 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 37 M 2023-12-06T04:19:34.773 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 210 M 2023-12-06T04:19:34.773 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:19:35.730 INFO:teuthology.orchestra.run.smithi134.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.14-33 15 MB/s | 8.6 MB 00:00 2023-12-06T04:19:36.297 INFO:teuthology.orchestra.run.smithi134.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 4.1 MB/s | 4.7 MB 00:01 2023-12-06T04:19:36.372 INFO:teuthology.orchestra.run.smithi134.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 4.0 MB/s | 4.9 MB 00:01 2023-12-06T04:19:36.397 INFO:teuthology.orchestra.run.smithi134.stdout:(4/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 2.2 MB/s | 225 kB 00:00 2023-12-06T04:19:36.606 INFO:teuthology.orchestra.run.smithi134.stdout:(5/8): libgfortran-8.5.0-21.el8.x86_64.rpm 3.0 MB/s | 645 kB 00:00 2023-12-06T04:19:36.657 INFO:teuthology.orchestra.run.smithi134.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2023-12-06T04:19:36.782 INFO:teuthology.orchestra.run.smithi134.stdout:(7/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 3.6 MB/s | 3.7 MB 00:01 2023-12-06T04:19:37.665 INFO:teuthology.orchestra.run.smithi134.stdout:(8/8): python3-scipy-1.0.0-21.module_el8.5.0+77 11 MB/s | 14 MB 00:01 2023-12-06T04:19:37.665 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:19:37.666 INFO:teuthology.orchestra.run.smithi134.stdout:Total 13 MB/s | 37 MB 00:02 2023-12-06T04:19:37.898 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:19:37.918 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:19:37.918 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:19:38.230 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:19:38.233 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:19:38.820 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:19:38.955 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-06T04:19:39.113 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2023-12-06T04:19:39.255 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-06T04:19:39.845 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2023-12-06T04:19:40.030 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-12-06T04:19:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-12-06T04:19:41.121 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-06T04:19:41.833 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-12-06T04:19:42.149 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-12-06T04:19:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-06T04:19:44.213 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-12-06T04:19:45.487 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-12-06T04:19:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.14-335.gd03fca4 8/8 2023-12-06T04:19:46.004 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.14-335.gd03fca4 8/8 2023-12-06T04:19:46.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.14-335.gd03fca4 1/8 2023-12-06T04:19:46.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-12-06T04:19:46.004 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-12-06T04:19:46.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-12-06T04:19:46.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-12-06T04:19:46.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-12-06T04:19:46.005 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-8.5.0-21.el8.x86_64 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-8.5.0-21.el8.x86_64 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.15-4.el8.x86_64 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:46.755 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:19:46.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2023-12-06T04:19:47.742 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:57 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:19:49.409 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:19:49.411 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-06T04:19:49.411 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:49.411 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:19:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 27 k 2023-12-06T04:19:49.411 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-06T04:19:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-06T04:19:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-06T04:19:49.411 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2023-12-06T04:19:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:49.413 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 1.9 M 2023-12-06T04:19:49.413 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 24 M 2023-12-06T04:19:49.413 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:19:49.962 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): ceph-mgr-rook-16.2.14-335.gd03fca4f.el8 180 kB/s | 27 kB 00:00 2023-12-06T04:19:50.154 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 58 kB/s | 20 kB 00:00 2023-12-06T04:19:50.180 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 72 kB/s | 27 kB 00:00 2023-12-06T04:19:50.404 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 689 kB/s | 155 kB 00:00 2023-12-06T04:19:50.471 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-modules-0.3.7-6.el8.noar 347 kB/s | 110 kB 00:00 2023-12-06T04:19:50.497 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 464 kB/s | 43 kB 00:00 2023-12-06T04:19:50.522 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 226 kB/s | 126 kB 00:00 2023-12-06T04:19:51.339 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 19 kB/s | 16 kB 00:00 2023-12-06T04:19:51.589 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 30 kB/s | 33 kB 00:01 2023-12-06T04:19:51.863 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 61 kB/s | 81 kB 00:01 2023-12-06T04:19:52.166 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-rsa-4.9-2.el8.noarch.rpm 112 kB/s | 64 kB 00:00 2023-12-06T04:19:52.248 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 159 kB/s | 61 kB 00:00 2023-12-06T04:19:53.159 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 656 kB/s | 1.2 MB 00:01 2023-12-06T04:19:53.163 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:19:53.163 INFO:teuthology.orchestra.run.smithi134.stdout:Total 522 kB/s | 1.9 MB 00:03 2023-12-06T04:19:53.225 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:19:53.241 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:19:53.241 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:19:53.330 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:19:53.333 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:19:53.816 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:19:54.046 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-12-06T04:19:54.236 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-12-06T04:19:54.454 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2023-12-06T04:19:54.709 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-12-06T04:19:54.941 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-12-06T04:19:55.189 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-12-06T04:19:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-12-06T04:19:55.748 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-12-06T04:19:56.762 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-12-06T04:19:57.059 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-12-06T04:19:57.243 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-12-06T04:19:57.435 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-12-06T04:19:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:16.2.14-335.gd03fca4f.el8.noarch 13/13 2023-12-06T04:19:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.14-335.gd03fca4f.el8.noarch 13/13 2023-12-06T04:19:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:16.2.14-335.gd03fca4f.el8.noarch 1/13 2023-12-06T04:19:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-12-06T04:19:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-12-06T04:19:57.946 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-12-06T04:19:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-12-06T04:19:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-12-06T04:19:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-12-06T04:19:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-12-06T04:19:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-12-06T04:19:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-12-06T04:19:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-12-06T04:19:57.947 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2023-12-06T04:19:58.693 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-06T04:19:58.694 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-06T04:19:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-06T04:19:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-06T04:19:58.695 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:19:58.695 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:19:58.828 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2023-12-06T04:19:59.685 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:09 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:01.371 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:01.372 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-06T04:20:01.372 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:01.372 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:20:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:16.2.14-335.gd03fca4f.el8 ceph-noarch 116 k 2023-12-06T04:20:01.372 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-06T04:20:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-12-06T04:20:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-12-06T04:20:01.372 INFO:teuthology.orchestra.run.smithi134.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-12-06T04:20:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-12-06T04:20:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-12-06T04:20:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:01.373 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:20:01.373 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:01.373 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2023-12-06T04:20:01.373 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:01.373 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 5.8 M 2023-12-06T04:20:01.374 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 24 M 2023-12-06T04:20:01.374 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:20:02.010 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): ceph-mgr-cephadm-16.2.14-335.gd03fca4f.e 321 kB/s | 116 kB 00:00 2023-12-06T04:20:02.207 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): python3-apipkg-1.5-6.el8.noarch.rpm 107 kB/s | 21 kB 00:00 2023-12-06T04:20:02.233 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 921 kB/s | 538 kB 00:00 2023-12-06T04:20:02.416 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.7 MB/s | 355 kB 00:00 2023-12-06T04:20:02.500 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 183 kB/s | 49 kB 00:00 2023-12-06T04:20:02.683 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 4.6 MB/s | 4.8 MB 00:01 2023-12-06T04:20:02.685 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:20:02.686 INFO:teuthology.orchestra.run.smithi134.stdout:Total 4.5 MB/s | 5.8 MB 00:01 2023-12-06T04:20:02.737 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:20:02.746 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:20:02.746 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:20:02.868 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:20:02.872 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:20:03.191 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:20:03.475 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2023-12-06T04:20:03.711 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2023-12-06T04:20:04.651 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2023-12-06T04:20:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2023-12-06T04:20:05.225 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2023-12-06T04:20:05.434 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 6/6 2023-12-06T04:20:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 6/6 2023-12-06T04:20:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 1/6 2023-12-06T04:20:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2023-12-06T04:20:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2023-12-06T04:20:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2023-12-06T04:20:05.713 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2023-12-06T04:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2023-12-06T04:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:06.398 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:16.2.14-335.gd03fca4f.el8.noarch 2023-12-06T04:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-apipkg-1.5-6.el8.noarch 2023-12-06T04:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-06T04:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-12-06T04:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-06T04:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-12-06T04:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:06.399 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:06.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2023-12-06T04:20:07.367 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:17 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:09.066 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:09.066 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 910 k 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2023-12-06T04:20:09.067 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:09.068 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 993 k 2023-12-06T04:20:09.068 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 2.8 M 2023-12-06T04:20:09.068 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:20:09.267 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): fuse-2.9.7-17.el8.x86_64.rpm 607 kB/s | 83 kB 00:00 2023-12-06T04:20:09.400 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): ceph-fuse-16.2.14-335.gd03fca4f.el8.x86_ 3.3 MB/s | 910 kB 00:00 2023-12-06T04:20:09.401 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:20:09.401 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.9 MB/s | 993 kB 00:00 2023-12-06T04:20:09.412 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:20:09.433 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:20:09.433 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:20:09.521 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:20:09.524 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:20:09.708 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:20:10.032 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.7-17.el8.x86_64 1/2 2023-12-06T04:20:10.258 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 2/2 2023-12-06T04:20:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 2/2 2023-12-06T04:20:10.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 1/2 2023-12-06T04:20:11.349 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 2/2 2023-12-06T04:20:11.349 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:11.349 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:20:11.349 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 fuse-2.9.7-17.el8.x86_64 2023-12-06T04:20:11.349 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:11.349 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:11.554 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2023-12-06T04:20:12.412 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:22 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:14.100 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:14.101 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:14.101 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2023-12-06T04:20:14.102 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:14.102 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:20:14.102 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 131 k 2023-12-06T04:20:14.102 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:14.102 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:20:14.102 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:14.102 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-06T04:20:14.102 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:14.103 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 131 k 2023-12-06T04:20:14.103 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 432 k 2023-12-06T04:20:14.103 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:20:14.298 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-16.2.14-335.gd03fca4f.el8.x86_64 669 kB/s | 131 kB 00:00 2023-12-06T04:20:14.298 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:20:14.299 INFO:teuthology.orchestra.run.smithi134.stdout:Total 664 kB/s | 131 kB 00:00 2023-12-06T04:20:14.299 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:20:14.304 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:20:14.304 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:20:14.353 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:20:14.356 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:20:14.483 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:20:14.723 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:15.013 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:15.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:15.673 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:15.673 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:20:15.674 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:20:15.674 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:15.674 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:15.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2023-12-06T04:20:16.729 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:26 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:18.223 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T04:20:18.447 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:18.448 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-06T04:20:18.449 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:18.548 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2023-12-06T04:20:19.410 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:29 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:21.086 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:21.086 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 25 k 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 25 k 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 107 k 2023-12-06T04:20:21.087 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:20:21.319 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-16.2.14-335.gd03fca4f.el8.x86_6 111 kB/s | 25 kB 00:00 2023-12-06T04:20:21.319 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:20:21.319 INFO:teuthology.orchestra.run.smithi134.stdout:Total 110 kB/s | 25 kB 00:00 2023-12-06T04:20:21.319 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:20:21.323 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:20:21.323 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:20:21.325 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:20:21.328 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:20:21.381 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:20:21.547 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:21.800 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:22.434 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:22.434 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:22.434 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:20:22.434 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:20:22.435 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:22.435 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:22.554 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2023-12-06T04:20:23.407 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:33 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:24.858 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T04:20:25.084 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:25.085 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-06T04:20:25.085 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:25.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2023-12-06T04:20:26.035 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:36 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:27.482 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T04:20:27.707 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:27.708 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-06T04:20:27.708 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:27.816 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2023-12-06T04:20:28.674 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:38 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:30.129 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T04:20:30.354 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:30.355 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-06T04:20:30.355 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:30.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2023-12-06T04:20:31.318 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:41 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:32.768 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T04:20:32.997 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:32.998 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-06T04:20:32.998 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:33.104 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2023-12-06T04:20:33.962 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:43 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:35.406 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T04:20:35.632 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:35.633 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-06T04:20:35.633 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:35.738 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2023-12-06T04:20:36.596 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:46 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:38.047 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:16.2.14-335.gd03fca4f.el8.x86_64 is already installed. 2023-12-06T04:20:38.271 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:38.272 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-12-06T04:20:38.272 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:38.377 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2023-12-06T04:20:39.228 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:49 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:40.902 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:40.902 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:40.902 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2023-12-06T04:20:40.902 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:40.902 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:20:40.902 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 88 k 2023-12-06T04:20:40.902 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:40.903 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:20:40.903 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:40.903 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-06T04:20:40.903 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:40.903 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 88 k 2023-12-06T04:20:40.903 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 240 k 2023-12-06T04:20:40.903 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:20:41.324 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-16.2.14-335.gd03fca4f.el8.x86_64.rpm 210 kB/s | 88 kB 00:00 2023-12-06T04:20:41.325 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:20:41.325 INFO:teuthology.orchestra.run.smithi134.stdout:Total 209 kB/s | 88 kB 00:00 2023-12-06T04:20:41.325 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:20:41.336 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:20:41.336 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:20:41.386 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:20:41.389 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:20:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:20:41.686 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:41.964 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:42.638 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:20:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:20:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:42.639 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:42.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2023-12-06T04:20:43.690 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:53 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:45.381 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:45.381 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:45.382 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2023-12-06T04:20:45.382 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:45.382 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:20:45.382 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 3.7 M 2023-12-06T04:20:45.382 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:45.382 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:20:45.382 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:45.382 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-06T04:20:45.382 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:45.383 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.7 M 2023-12-06T04:20:45.383 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 15 M 2023-12-06T04:20:45.383 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:20:45.843 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-16.2.14-335.gd03fca4f.el8.x86_64.rpm 8.0 MB/s | 3.7 MB 00:00 2023-12-06T04:20:45.844 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:20:45.844 INFO:teuthology.orchestra.run.smithi134.stdout:Total 8.0 MB/s | 3.7 MB 00:00 2023-12-06T04:20:45.844 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:20:45.856 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:20:45.856 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:20:45.919 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:20:45.923 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:20:46.359 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:20:46.578 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:46.999 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:47.676 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:47.676 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:47.676 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:20:47.676 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:20:47.677 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:47.677 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:47.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2023-12-06T04:20:48.740 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:58 ago on Wed 06 Dec 2023 04:17:50 AM UTC. 2023-12-06T04:20:50.412 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-12-06T04:20:50.412 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2023-12-06T04:20:50.413 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:50.413 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-12-06T04:20:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:16.2.14-335.gd03fca4f.el8 ceph 175 k 2023-12-06T04:20:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:50.413 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-12-06T04:20:50.413 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2023-12-06T04:20:50.413 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2023-12-06T04:20:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:50.414 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 175 k 2023-12-06T04:20:50.414 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 523 k 2023-12-06T04:20:50.414 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-12-06T04:20:50.929 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-16.2.14-335.gd03fca4f.el8.x86_64.rpm 340 kB/s | 175 kB 00:00 2023-12-06T04:20:50.930 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-12-06T04:20:50.933 INFO:teuthology.orchestra.run.smithi134.stdout:Total 339 kB/s | 175 kB 00:00 2023-12-06T04:20:50.933 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-12-06T04:20:50.941 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-12-06T04:20:50.941 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-12-06T04:20:50.991 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-12-06T04:20:50.994 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-12-06T04:20:51.112 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-12-06T04:20:51.301 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:51.614 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:52.333 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:16.2.14-335.gd03fca4f.el8.x86_64 1/1 2023-12-06T04:20:52.333 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:52.333 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-12-06T04:20:52.333 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:16.2.14-335.gd03fca4f.el8.x86_64 2023-12-06T04:20:52.333 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:52.334 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-12-06T04:20:52.518 DEBUG:teuthology.parallel:result is None 2023-12-06T04:20:52.519 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T04:20:52.665 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-06T04:20:52.687 INFO:teuthology.orchestra.run.smithi134.stdout:16.2.14-335.gd03fca4f.el8 2023-12-06T04:20:52.688 INFO:teuthology.packaging:The installed version of ceph is 16.2.14-335.gd03fca4f.el8 2023-12-06T04:20:52.688 INFO:teuthology.task.install:The correct ceph version 16.2.14-335.gd03fca4f is installed. 2023-12-06T04:20:52.688 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-06T04:20:52.688 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:52.688 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-06T04:20:52.756 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-06T04:20:52.756 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:52.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2023-12-06T04:20:52.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-06T04:20:52.889 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-06T04:20:52.890 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:52.890 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-06T04:20:52.956 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-06T04:20:53.023 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-06T04:20:53.023 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:53.023 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2023-12-06T04:20:53.090 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-06T04:20:53.157 INFO:teuthology.run_tasks:Running task ceph... 2023-12-06T04:20:53.223 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-06T04:20:53.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2023-12-06T04:20:53.250 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-06T04:20:53.250 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-06T04:20:53.317 INFO:tasks.ceph:Creating extra log directories... 2023-12-06T04:20:53.317 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-06T04:20:53.396 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-06T04:20:53.396 INFO:tasks.ceph:config {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-06T04:20:53.396 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760', 'branch': 'wip-yuri6-testing-2023-12-05-0753-pacific', 'description': 'rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7478760', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri6-testing-2023-12-05-0753-pacific'}, 'ceph': {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri6-testing-2023-12-05-0753-pacific', 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 5062, 'sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'wip-yuri6-testing-2023-12-05-0753-pacific', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'd03fca4f35d43f61b4679936aef7bd2f01cced0b', 'targets': {'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDcXsvfoj5PjdLWsLsc9l3R4Vo1sdCldN2FJevu7vlm3NZHmL6gJKaKcOLpsRwHkAVrWc6jxrP5Lv18HimfL0/I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_generic.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-05_19:07:37', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-06T04:20:53.397 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-06T04:20:53.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2023-12-06T04:20:53.508 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:53.509 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2023-12-06T04:20:53.567 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-06T04:20:53.567 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2023-12-06T04:20:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-06T04:20:53.625 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T04:20:53.625 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 389111 Links: 1 2023-12-06T04:20:53.625 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T04:20:53.626 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T04:20:53.626 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-06 04:20:46.748164653 +0000 2023-12-06T04:20:53.626 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-06 04:16:37.957663003 +0000 2023-12-06T04:20:53.626 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-06 04:16:37.957663003 +0000 2023-12-06T04:20:53.626 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-12-06T04:20:53.626 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-06T04:20:53.691 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-06T04:20:53.691 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-06T04:20:53.691 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000201533 s, 2.5 MB/s 2023-12-06T04:20:53.692 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-06T04:20:53.751 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2023-12-06T04:20:53.809 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-06T04:20:53.809 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T04:20:53.809 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 396403 Links: 1 2023-12-06T04:20:53.809 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T04:20:53.809 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T04:20:53.809 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-06 04:20:46.748164653 +0000 2023-12-06T04:20:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-06 04:16:38.504650432 +0000 2023-12-06T04:20:53.810 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-06 04:16:38.504650432 +0000 2023-12-06T04:20:53.810 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-12-06T04:20:53.810 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-06T04:20:53.875 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-06T04:20:53.875 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-06T04:20:53.875 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000211185 s, 2.4 MB/s 2023-12-06T04:20:53.876 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-06T04:20:53.935 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2023-12-06T04:20:53.993 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-06T04:20:53.993 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T04:20:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 399556 Links: 1 2023-12-06T04:20:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T04:20:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T04:20:53.993 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-06 04:20:46.749164630 +0000 2023-12-06T04:20:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-06 04:16:39.029638368 +0000 2023-12-06T04:20:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-06 04:16:39.029638368 +0000 2023-12-06T04:20:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-12-06T04:20:53.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-06T04:20:54.059 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-06T04:20:54.059 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-06T04:20:54.059 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00021529 s, 2.4 MB/s 2023-12-06T04:20:54.060 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-06T04:20:54.119 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2023-12-06T04:20:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-06T04:20:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-06T04:20:54.177 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 399659 Links: 1 2023-12-06T04:20:54.177 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-06T04:20:54.177 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-12-06T04:20:54.177 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-12-06 04:20:46.749164630 +0000 2023-12-06T04:20:54.177 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-12-06 04:16:39.567626004 +0000 2023-12-06T04:20:54.177 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-12-06 04:16:39.567626004 +0000 2023-12-06T04:20:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-12-06T04:20:54.177 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-06T04:20:54.243 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-12-06T04:20:54.243 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-12-06T04:20:54.243 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000232318 s, 2.2 MB/s 2023-12-06T04:20:54.244 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-06T04:20:54.303 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-12-06T04:20:54.304 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-12-06T04:20:54.304 INFO:tasks.ceph:Generating config... 2023-12-06T04:20:54.305 INFO:tasks.ceph:[client] rbd default format = 1 2023-12-06T04:20:54.305 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-12-06T04:20:54.305 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-12-06T04:20:54.305 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-06T04:20:54.305 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-06T04:20:54.305 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-06T04:20:54.305 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-06T04:20:54.305 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-06T04:20:54.305 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-06T04:20:54.306 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-06T04:20:54.307 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-06T04:20:54.307 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-06T04:20:54.307 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-12-06T04:20:54.307 INFO:tasks.ceph:Setting up mon.a... 2023-12-06T04:20:54.307 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-06T04:20:54.490 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.keyring 2023-12-06T04:20:54.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-06T04:20:54.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-06T04:20:54.600 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.134')] 2023-12-06T04:20:54.600 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.134', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default format': 1}, 'mon.a': {}} 2023-12-06T04:20:54.601 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:54.601 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-06T04:20:54.658 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.134 --print /home/ubuntu/cephtest/ceph.monmap 2023-12-06T04:20:54.736 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-06T04:20:54.736 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: generated fsid 4e38094a-d24c-4240-bea0-15d2d8796a3c 2023-12-06T04:20:54.736 INFO:teuthology.orchestra.run.smithi134.stdout:epoch 0 2023-12-06T04:20:54.736 INFO:teuthology.orchestra.run.smithi134.stdout:fsid 4e38094a-d24c-4240-bea0-15d2d8796a3c 2023-12-06T04:20:54.736 INFO:teuthology.orchestra.run.smithi134.stdout:last_changed 2023-12-06T04:20:54.736107+0000 2023-12-06T04:20:54.736 INFO:teuthology.orchestra.run.smithi134.stdout:created 2023-12-06T04:20:54.736107+0000 2023-12-06T04:20:54.736 INFO:teuthology.orchestra.run.smithi134.stdout:min_mon_release 0 (unknown) 2023-12-06T04:20:54.736 INFO:teuthology.orchestra.run.smithi134.stdout:election_strategy: 1 2023-12-06T04:20:54.737 INFO:teuthology.orchestra.run.smithi134.stdout:0: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.a 2023-12-06T04:20:54.737 INFO:teuthology.orchestra.run.smithi134.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-12-06T04:20:54.738 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-06T04:20:54.796 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4e38094a-d24c-4240-bea0-15d2d8796a3c... 2023-12-06T04:20:54.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.881 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2023-12-06T04:20:54.882 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2023-12-06T04:20:54.883 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = 172.21.15.134 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: mon client directed command retry = 5 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: ms inject socket failures = 5000 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 4e38094a-d24c-4240-bea0-15d2d8796a3c 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2023-12-06T04:20:54.884 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2023-12-06T04:20:54.885 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = stupid 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2023-12-06T04:20:54.886 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: osd shutdown pgref assert = True 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2023-12-06T04:20:54.887 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2023-12-06T04:20:54.888 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-06T04:20:54.889 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-06T04:20:54.890 INFO:teuthology.orchestra.run.smithi134.stdout: rbd default format = 1 2023-12-06T04:20:54.890 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2023-12-06T04:20:54.891 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-06T04:20:54.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-06T04:20:54.983 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-06T04:20:54.983 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:54.983 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-06T04:20:55.001 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:55.001 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-06T04:20:55.059 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T04:20:55.059 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:55.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-06T04:20:55.059 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-06T04:20:55.135 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:20:55.135 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-06T04:20:55.193 INFO:tasks.ceph:Setting up mon nodes... 2023-12-06T04:20:55.193 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-06T04:20:55.193 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-06T04:20:55.282 INFO:teuthology.orchestra.run.smithi134.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-06T04:20:55.284 INFO:tasks.ceph:Setting up mds nodes... 2023-12-06T04:20:55.284 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-06T04:20:55.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-06T04:20:55.323 INFO:teuthology.orchestra.run.smithi134.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-06T04:20:55.335 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-06T04:20:55.335 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-12-06T04:20:55.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-06T04:20:55.402 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-12-06T04:20:55.402 INFO:tasks.ceph:role: osd.0 2023-12-06T04:20:55.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T04:20:55.403 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-06T04:20:55.476 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-06T04:20:55.476 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-06T04:20:55.476 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-06T04:20:55.476 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-06T04:20:55.476 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-06T04:20:55.477 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-12-06T04:20:55.477 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-06T04:20:55.477 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-06T04:20:55.477 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-06T04:20:55.477 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-06T04:20:55.904 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-12-06T04:20:55.905 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-12-06T04:20:55.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-06T04:20:56.095 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-06T04:20:56.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-06T04:20:56.197 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-12-06T04:20:56.197 INFO:tasks.ceph:role: osd.1 2023-12-06T04:20:56.197 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T04:20:56.197 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-06T04:20:56.271 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-06T04:20:56.271 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-06T04:20:56.271 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-06T04:20:56.271 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-06T04:20:56.271 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-06T04:20:56.272 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-12-06T04:20:56.272 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-06T04:20:56.272 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-06T04:20:56.272 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-06T04:20:56.272 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-06T04:20:56.693 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-12-06T04:20:56.694 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-12-06T04:20:56.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-06T04:20:56.799 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-06T04:20:56.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-06T04:20:56.897 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-12-06T04:20:56.897 INFO:tasks.ceph:role: osd.2 2023-12-06T04:20:56.897 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T04:20:56.897 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-06T04:20:56.971 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-06T04:20:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-06T04:20:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-06T04:20:56.971 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-06T04:20:56.971 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-06T04:20:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-12-06T04:20:56.972 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-06T04:20:56.972 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-06T04:20:56.972 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-06T04:20:56.972 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-06T04:20:57.414 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-12-06T04:20:57.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-12-06T04:20:57.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-06T04:20:57.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-06T04:20:57.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-06T04:20:57.696 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:20:57.695+0000 7f267335f380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-06T04:20:57.698 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:20:57.696+0000 7f267335f380 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-06T04:20:57.698 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:20:57.696+0000 7f267335f380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-06T04:20:57.698 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:20:57.696+0000 7f267335f380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-06T04:20:57.698 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:20:57.696+0000 7f267335f380 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-06T04:20:57.700 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:20:57.699+0000 7f267335f380 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-06T04:21:00.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-06T04:21:00.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-06T04:21:00.662 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:00.661+0000 7f386f278380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-06T04:21:00.663 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:00.661+0000 7f386f278380 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-06T04:21:00.663 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:00.661+0000 7f386f278380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-06T04:21:00.663 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:00.661+0000 7f386f278380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-06T04:21:00.663 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:00.661+0000 7f386f278380 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-06T04:21:00.663 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:00.661+0000 7f386f278380 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-06T04:21:03.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-06T04:21:03.539 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-06T04:21:03.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:03.626+0000 7f15896c3380 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-06T04:21:03.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:03.626+0000 7f15896c3380 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-06T04:21:03.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:03.626+0000 7f15896c3380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-06T04:21:03.628 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:03.626+0000 7f15896c3380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-06T04:21:03.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:03.626+0000 7f15896c3380 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-06T04:21:03.629 INFO:teuthology.orchestra.run.smithi134.stderr:2023-12-06T04:21:03.627+0000 7f15896c3380 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-06T04:21:06.471 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-06T04:21:06.503 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-06T04:21:06.503 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:21:06.503 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-06T04:21:06.574 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:21:06.574 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-06T04:21:06.643 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:21:06.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-06T04:21:06.712 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:21:06.712 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-06T04:21:06.779 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:21:06.779 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-06T04:21:06.837 INFO:tasks.ceph:Adding keys to all mons... 2023-12-06T04:21:06.837 DEBUG:teuthology.orchestra.run.smithi134:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr.x] 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCn9m9lj6TOEBAA0EuVVPWtaqT0nshsYiBPtw== 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.0] 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCp9m9l9dWAKRAApNm/BWoSjL8lK3/fWWMX6A== 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.1] 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCs9m9lfAp6JxAA8NFR9ckaUH5YdVBHk6fSXQ== 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout:[osd.2] 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCv9m9lfDhqJRAAw9z1+RKP9NXNEEj9Oq4fQw== 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2023-12-06T04:21:06.903 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCn9m9lQbBKExAAkEaFzITcCtnyLq8mV6tXJQ== 2023-12-06T04:21:06.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-06T04:21:06.992 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-06T04:21:07.040 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-06T04:21:07.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-06T04:21:07.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-06T04:21:07.185 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-06T04:21:07.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-06T04:21:07.212 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-06T04:21:07.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-06T04:21:07.331 DEBUG:teuthology.orchestra.run.smithi134:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-06T04:21:07.389 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-06T04:21:07.389 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-06T04:21:07.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-06T04:21:07.431 INFO:tasks.ceph.mon.a:Started 2023-12-06T04:21:07.432 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-06T04:21:07.432 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-06T04:21:07.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-06T04:21:07.434 INFO:tasks.ceph.mgr.x:Started 2023-12-06T04:21:07.434 INFO:tasks.ceph:Setting crush tunables to default 2023-12-06T04:21:07.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd crush tunables default 2023-12-06T04:21:07.649 INFO:teuthology.orchestra.run.smithi134.stderr:adjusted tunables profile to default 2023-12-06T04:21:07.659 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-06T04:21:07.659 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:21:07.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-06T04:21:07.686 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:21:07.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-06T04:21:07.752 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:21:07.753 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-06T04:21:07.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 6c916e77-1f95-4e1b-811f-8bee318dbfa3 0 2023-12-06T04:21:07.863 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:07.862+0000 7f3e306fa680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-06T04:21:07.936 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:07.935+0000 7f3e306fa680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-06T04:21:08.062 INFO:teuthology.orchestra.run.smithi134.stdout:0 2023-12-06T04:21:08.074 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new c992bccd-c2b5-45be-916a-d3ce77576215 1 2023-12-06T04:21:08.318 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-12-06T04:21:08.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new d5865df4-d87f-4cbb-a273-ed6b54e0d8ea 2 2023-12-06T04:21:08.373 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:08.371+0000 7f3e306fa680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-06T04:21:08.534 INFO:teuthology.orchestra.run.smithi134.stdout:2 2023-12-06T04:21:08.546 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-06T04:21:08.546 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-06T04:21:08.588 INFO:tasks.ceph.osd.0:Started 2023-12-06T04:21:08.589 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-06T04:21:08.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-06T04:21:08.591 INFO:tasks.ceph.osd.1:Started 2023-12-06T04:21:08.591 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-06T04:21:08.591 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-06T04:21:08.593 INFO:tasks.ceph.osd.2:Started 2023-12-06T04:21:08.593 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T04:21:08.790 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:21:08.791 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":5,"fsid":"4e38094a-d24c-4240-bea0-15d2d8796a3c","created":"2023-12-06T04:21:07.554985+0000","modified":"2023-12-06T04:21:08.532916+0000","last_up_change":"0.000000","last_in_change":"2023-12-06T04:21:08.532916+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"6c916e77-1f95-4e1b-811f-8bee318dbfa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c992bccd-c2b5-45be-916a-d3ce77576215","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5865df4-d87f-4cbb-a273-ed6b54e0d8ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T04:21:08.803 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-06T04:21:08.803 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-06T04:21:09.105 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-06T04:21:09.149 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:09.148+0000 7f3e306fa680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-06T04:21:09.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:21:09.184+0000 7f19895b6380 -1 Falling back to public interface 2023-12-06T04:21:09.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:21:09.196+0000 7fc5a7f70380 -1 Falling back to public interface 2023-12-06T04:21:09.207 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-12-06T04:21:09.205+0000 7f38ea691380 -1 Falling back to public interface 2023-12-06T04:21:09.220 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:09.219+0000 7f3e306fa680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-06T04:21:09.304 INFO:teuthology.misc.health.smithi134.stdout: 2023-12-06T04:21:09.304 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":5,"fsid":"4e38094a-d24c-4240-bea0-15d2d8796a3c","created":"2023-12-06T04:21:07.554985+0000","modified":"2023-12-06T04:21:08.532916+0000","last_up_change":"0.000000","last_in_change":"2023-12-06T04:21:08.532916+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"6c916e77-1f95-4e1b-811f-8bee318dbfa3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c992bccd-c2b5-45be-916a-d3ce77576215","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5865df4-d87f-4cbb-a273-ed6b54e0d8ea","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T04:21:09.315 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-12-06T04:21:09.415 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:09.413+0000 7f3e306fa680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-06T04:21:09.851 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:09.850+0000 7f3e306fa680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-06T04:21:09.952 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:09.951+0000 7f3e306fa680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-06T04:21:10.108 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:10.106+0000 7f3e306fa680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-06T04:21:10.184 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:10.183+0000 7f3e306fa680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-06T04:21:10.253 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:10.251+0000 7f3e306fa680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-06T04:21:10.510 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:10.508+0000 7f3e306fa680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-06T04:21:10.706 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:10.705+0000 7f3e306fa680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-06T04:21:11.370 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:11.368+0000 7f3e306fa680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-06T04:21:11.440 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:11.438+0000 7f3e306fa680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-06T04:21:11.518 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:11.516+0000 7f3e306fa680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-06T04:21:11.670 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:11.668+0000 7f3e306fa680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-06T04:21:11.741 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:11.740+0000 7f3e306fa680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-06T04:21:11.857 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:11.855+0000 7f3e306fa680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-06T04:21:11.982 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:11.981+0000 7f3e306fa680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-06T04:21:12.340 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:12.339+0000 7f3e306fa680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-06T04:21:12.411 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:12.409+0000 7f3e306fa680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-06T04:21:12.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:21:12.712+0000 7f19895b6380 -1 osd.0 0 log_to_monitors {default=true} 2023-12-06T04:21:12.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:21:12.729+0000 7fc5a7f70380 -1 osd.1 0 log_to_monitors {default=true} 2023-12-06T04:21:12.731 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-12-06T04:21:12.730+0000 7f38ea691380 -1 osd.2 0 log_to_monitors {default=true} 2023-12-06T04:21:13.430 INFO:tasks.ceph.mgr.x.smithi134.stderr:2023-12-06T04:21:13.428+0000 7f3de5c13700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-12-06T04:21:14.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:21:14.527+0000 7f198175a700 -1 osd.0 0 waiting for initial osdmap 2023-12-06T04:21:14.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:21:14.528+0000 7f197ff57700 -1 osd.0 0 waiting for initial osdmap 2023-12-06T04:21:14.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:21:14.527+0000 7fc59e911700 -1 osd.1 0 waiting for initial osdmap 2023-12-06T04:21:14.530 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-12-06T04:21:14.528+0000 7f38e2835700 -1 osd.2 0 waiting for initial osdmap 2023-12-06T04:21:14.530 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-12-06T04:21:14.528+0000 7f38e1032700 -1 osd.2 0 waiting for initial osdmap 2023-12-06T04:21:14.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:21:14.532+0000 7f197c6d3700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T04:21:14.534 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-12-06T04:21:14.533+0000 7f38dd7ae700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T04:21:14.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:21:14.533+0000 7fc59b08d700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-06T04:21:15.617 DEBUG:teuthology.orchestra.run.smithi134:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-06T04:21:15.902 INFO:teuthology.misc.health.smithi134.stdout: 2023-12-06T04:21:15.902 INFO:teuthology.misc.health.smithi134.stdout:{"epoch":8,"fsid":"4e38094a-d24c-4240-bea0-15d2d8796a3c","created":"2023-12-06T04:21:07.554985+0000","modified":"2023-12-06T04:21:15.523261+0000","last_up_change":"2023-12-06T04:21:15.523261+0000","last_in_change":"2023-12-06T04:21:08.532916+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"6c916e77-1f95-4e1b-811f-8bee318dbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":114486},{"type":"v1","addr":"172.21.15.134:6801","nonce":114486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":114486},{"type":"v1","addr":"172.21.15.134:6803","nonce":114486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":114486},{"type":"v1","addr":"172.21.15.134:6807","nonce":114486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":114486},{"type":"v1","addr":"172.21.15.134:6805","nonce":114486}]},"public_addr":"172.21.15.134:6801/114486","cluster_addr":"172.21.15.134:6803/114486","heartbeat_back_addr":"172.21.15.134:6807/114486","heartbeat_front_addr":"172.21.15.134:6805/114486","state":["exists","up"]},{"osd":1,"uuid":"c992bccd-c2b5-45be-916a-d3ce77576215","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":114487},{"type":"v1","addr":"172.21.15.134:6809","nonce":114487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":114487},{"type":"v1","addr":"172.21.15.134:6811","nonce":114487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":114487},{"type":"v1","addr":"172.21.15.134:6815","nonce":114487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":114487},{"type":"v1","addr":"172.21.15.134:6813","nonce":114487}]},"public_addr":"172.21.15.134:6809/114487","cluster_addr":"172.21.15.134:6811/114487","heartbeat_back_addr":"172.21.15.134:6815/114487","heartbeat_front_addr":"172.21.15.134:6813/114487","state":["exists","up"]},{"osd":2,"uuid":"d5865df4-d87f-4cbb-a273-ed6b54e0d8ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":114516},{"type":"v1","addr":"172.21.15.134:6817","nonce":114516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":114516},{"type":"v1","addr":"172.21.15.134:6819","nonce":114516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":114516},{"type":"v1","addr":"172.21.15.134:6823","nonce":114516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":114516},{"type":"v1","addr":"172.21.15.134:6821","nonce":114516}]},"public_addr":"172.21.15.134:6817/114516","cluster_addr":"172.21.15.134:6819/114516","heartbeat_back_addr":"172.21.15.134:6823/114516","heartbeat_front_addr":"172.21.15.134:6821/114516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T04:21:15.914 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-12-06T04:21:15.914 INFO:tasks.ceph:Creating RBD pool 2023-12-06T04:21:15.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd pool create rbd 8 2023-12-06T04:21:16.538 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'rbd' created 2023-12-06T04:21:16.550 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-12-06T04:21:17.545 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rbd' on pool 'rbd' 2023-12-06T04:21:17.557 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-06T04:21:17.557 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-06T04:21:17.558 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-06T04:21:17.558 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-06T04:21:17.558 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-06T04:21:17.888 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:21:17.901 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":114077},{"type":"v1","addr":"172.21.15.134:6825","nonce":114077}]},"active_addr":"172.21.15.134:6825/114077","active_change":"2023-12-06T04:21:12.423326+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3986249552}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.134:0","nonce":3757574811}]}]} 2023-12-06T04:21:17.902 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-06T04:21:17.902 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-06T04:21:17.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T04:21:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:21:18.188 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":10,"fsid":"4e38094a-d24c-4240-bea0-15d2d8796a3c","created":"2023-12-06T04:21:07.554985+0000","modified":"2023-12-06T04:21:17.530504+0000","last_up_change":"2023-12-06T04:21:15.523261+0000","last_in_change":"2023-12-06T04:21:08.532916+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-06T04:21:15.563089+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-06T04:21:16.228970+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"6c916e77-1f95-4e1b-811f-8bee318dbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":114486},{"type":"v1","addr":"172.21.15.134:6801","nonce":114486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":114486},{"type":"v1","addr":"172.21.15.134:6803","nonce":114486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":114486},{"type":"v1","addr":"172.21.15.134:6807","nonce":114486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":114486},{"type":"v1","addr":"172.21.15.134:6805","nonce":114486}]},"public_addr":"172.21.15.134:6801/114486","cluster_addr":"172.21.15.134:6803/114486","heartbeat_back_addr":"172.21.15.134:6807/114486","heartbeat_front_addr":"172.21.15.134:6805/114486","state":["exists","up"]},{"osd":1,"uuid":"c992bccd-c2b5-45be-916a-d3ce77576215","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":114487},{"type":"v1","addr":"172.21.15.134:6809","nonce":114487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":114487},{"type":"v1","addr":"172.21.15.134:6811","nonce":114487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":114487},{"type":"v1","addr":"172.21.15.134:6815","nonce":114487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":114487},{"type":"v1","addr":"172.21.15.134:6813","nonce":114487}]},"public_addr":"172.21.15.134:6809/114487","cluster_addr":"172.21.15.134:6811/114487","heartbeat_back_addr":"172.21.15.134:6815/114487","heartbeat_front_addr":"172.21.15.134:6813/114487","state":["exists","up"]},{"osd":2,"uuid":"d5865df4-d87f-4cbb-a273-ed6b54e0d8ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":114516},{"type":"v1","addr":"172.21.15.134:6817","nonce":114516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":114516},{"type":"v1","addr":"172.21.15.134:6819","nonce":114516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":114516},{"type":"v1","addr":"172.21.15.134:6823","nonce":114516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":114516},{"type":"v1","addr":"172.21.15.134:6821","nonce":114516}]},"public_addr":"172.21.15.134:6817/114516","cluster_addr":"172.21.15.134:6819/114516","heartbeat_back_addr":"172.21.15.134:6823/114516","heartbeat_front_addr":"172.21.15.134:6821/114516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.721009+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.761363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.759135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T04:21:18.201 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-06T04:21:18.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T04:21:18.489 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:21:18.489 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":10,"fsid":"4e38094a-d24c-4240-bea0-15d2d8796a3c","created":"2023-12-06T04:21:07.554985+0000","modified":"2023-12-06T04:21:17.530504+0000","last_up_change":"2023-12-06T04:21:15.523261+0000","last_in_change":"2023-12-06T04:21:08.532916+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-06T04:21:15.563089+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-06T04:21:16.228970+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"6c916e77-1f95-4e1b-811f-8bee318dbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":114486},{"type":"v1","addr":"172.21.15.134:6801","nonce":114486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":114486},{"type":"v1","addr":"172.21.15.134:6803","nonce":114486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":114486},{"type":"v1","addr":"172.21.15.134:6807","nonce":114486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":114486},{"type":"v1","addr":"172.21.15.134:6805","nonce":114486}]},"public_addr":"172.21.15.134:6801/114486","cluster_addr":"172.21.15.134:6803/114486","heartbeat_back_addr":"172.21.15.134:6807/114486","heartbeat_front_addr":"172.21.15.134:6805/114486","state":["exists","up"]},{"osd":1,"uuid":"c992bccd-c2b5-45be-916a-d3ce77576215","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":114487},{"type":"v1","addr":"172.21.15.134:6809","nonce":114487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":114487},{"type":"v1","addr":"172.21.15.134:6811","nonce":114487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":114487},{"type":"v1","addr":"172.21.15.134:6815","nonce":114487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":114487},{"type":"v1","addr":"172.21.15.134:6813","nonce":114487}]},"public_addr":"172.21.15.134:6809/114487","cluster_addr":"172.21.15.134:6811/114487","heartbeat_back_addr":"172.21.15.134:6815/114487","heartbeat_front_addr":"172.21.15.134:6813/114487","state":["exists","up"]},{"osd":2,"uuid":"d5865df4-d87f-4cbb-a273-ed6b54e0d8ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":114516},{"type":"v1","addr":"172.21.15.134:6817","nonce":114516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":114516},{"type":"v1","addr":"172.21.15.134:6819","nonce":114516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":114516},{"type":"v1","addr":"172.21.15.134:6823","nonce":114516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":114516},{"type":"v1","addr":"172.21.15.134:6821","nonce":114516}]},"public_addr":"172.21.15.134:6817/114516","cluster_addr":"172.21.15.134:6819/114516","heartbeat_back_addr":"172.21.15.134:6823/114516","heartbeat_front_addr":"172.21.15.134:6821/114516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.721009+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.761363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.759135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T04:21:18.503 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-06T04:21:18.650 INFO:teuthology.orchestra.run.smithi134.stdout:34359738371 2023-12-06T04:21:18.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-06T04:21:18.796 INFO:teuthology.orchestra.run.smithi134.stdout:34359738370 2023-12-06T04:21:18.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-06T04:21:18.942 INFO:teuthology.orchestra.run.smithi134.stdout:34359738371 2023-12-06T04:21:18.943 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-06T04:21:19.227 INFO:teuthology.orchestra.run.smithi134.stdout:34359738370 2023-12-06T04:21:19.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.0 2023-12-06T04:21:20.242 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-06T04:21:20.540 INFO:teuthology.orchestra.run.smithi134.stdout:34359738370 2023-12-06T04:21:20.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.0 2023-12-06T04:21:21.555 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-06T04:21:21.856 INFO:teuthology.orchestra.run.smithi134.stdout:34359738371 2023-12-06T04:21:21.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.0 2023-12-06T04:21:21.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-06T04:21:22.152 INFO:teuthology.orchestra.run.smithi134.stdout:34359738370 2023-12-06T04:21:22.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738370 for osd.1 2023-12-06T04:21:22.166 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-06T04:21:22.450 INFO:teuthology.orchestra.run.smithi134.stdout:34359738371 2023-12-06T04:21:22.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.2 2023-12-06T04:21:22.464 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-06T04:21:22.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T04:21:22.746 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:21:22.749 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T04:21:22.760 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-12-06T04:21:22.428317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":891568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":891264,"kb_avail":282223952,"statfs":{"total":289910292480,"available":288997326848,"internally_reserved":0,"allocated":286720,"data_stored":78184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912654336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548082+0000","last_change":"2023-12-06T04:21:17.544067+0000","last_active":"2023-12-06T04:21:17.548082+0000","last_peered":"2023-12-06T04:21:17.548082+0000","last_clean":"2023-12-06T04:21:17.548082+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T04:21:17.548082+0000","last_undegraded":"2023-12-06T04:21:17.548082+0000","last_fullsized":"2023-12-06T04:21:17.548082+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.545971+0000","last_change":"2023-12-06T04:21:17.543728+0000","last_active":"2023-12-06T04:21:17.545971+0000","last_peered":"2023-12-06T04:21:17.545971+0000","last_clean":"2023-12-06T04:21:17.545971+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T04:21:17.545971+0000","last_undegraded":"2023-12-06T04:21:17.545971+0000","last_fullsized":"2023-12-06T04:21:17.545971+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.545882+0000","last_change":"2023-12-06T04:21:17.543136+0000","last_active":"2023-12-06T04:21:17.545882+0000","last_peered":"2023-12-06T04:21:17.545882+0000","last_clean":"2023-12-06T04:21:17.545882+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T04:21:17.545882+0000","last_undegraded":"2023-12-06T04:21:17.545882+0000","last_fullsized":"2023-12-06T04:21:17.545882+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548065+0000","last_change":"2023-12-06T04:21:17.543910+0000","last_active":"2023-12-06T04:21:17.548065+0000","last_peered":"2023-12-06T04:21:17.548065+0000","last_clean":"2023-12-06T04:21:17.548065+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T04:21:17.548065+0000","last_undegraded":"2023-12-06T04:21:17.548065+0000","last_fullsized":"2023-12-06T04:21:17.548065+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548160+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T04:21:17.548160+0000","last_peered":"2023-12-06T04:21:17.548160+0000","last_clean":"2023-12-06T04:21:17.548160+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T04:21:17.548160+0000","last_undegraded":"2023-12-06T04:21:17.548160+0000","last_fullsized":"2023-12-06T04:21:17.548160+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.544419+0000","last_change":"2023-12-06T04:21:17.542924+0000","last_active":"2023-12-06T04:21:17.544419+0000","last_peered":"2023-12-06T04:21:17.544419+0000","last_clean":"2023-12-06T04:21:17.544419+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T04:21:17.544419+0000","last_undegraded":"2023-12-06T04:21:17.544419+0000","last_fullsized":"2023-12-06T04:21:17.544419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.544060+0000","last_change":"2023-12-06T04:21:17.543206+0000","last_active":"2023-12-06T04:21:17.544060+0000","last_peered":"2023-12-06T04:21:17.544060+0000","last_clean":"2023-12-06T04:21:17.544060+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T04:21:17.544060+0000","last_undegraded":"2023-12-06T04:21:17.544060+0000","last_fullsized":"2023-12-06T04:21:17.544060+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548473+0000","last_change":"2023-12-06T04:21:17.545280+0000","last_active":"2023-12-06T04:21:17.548473+0000","last_peered":"2023-12-06T04:21:17.548473+0000","last_clean":"2023-12-06T04:21:17.548473+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T04:21:17.548473+0000","last_undegraded":"2023-12-06T04:21:17.548473+0000","last_fullsized":"2023-12-06T04:21:17.548473+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548167+0000","last_change":"2023-12-06T04:21:17.545451+0000","last_active":"2023-12-06T04:21:17.548167+0000","last_peered":"2023-12-06T04:21:17.548167+0000","last_clean":"2023-12-06T04:21:17.548167+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T04:21:17.548167+0000","last_undegraded":"2023-12-06T04:21:17.548167+0000","last_fullsized":"2023-12-06T04:21:17.548167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297188,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074652,"statfs":{"total":96636764160,"available":96332443648,"internally_reserved":0,"allocated":94208,"data_stored":25688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297188,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074652,"statfs":{"total":96636764160,"available":96332443648,"internally_reserved":0,"allocated":94208,"data_stored":25688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":26808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T04:21:22.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T04:21:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:21:23.044 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T04:21:23.055 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":12,"stamp":"2023-12-06T04:21:22.428317+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":891568,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":891264,"kb_avail":282223952,"statfs":{"total":289910292480,"available":288997326848,"internally_reserved":0,"allocated":286720,"data_stored":78184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912654336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548082+0000","last_change":"2023-12-06T04:21:17.544067+0000","last_active":"2023-12-06T04:21:17.548082+0000","last_peered":"2023-12-06T04:21:17.548082+0000","last_clean":"2023-12-06T04:21:17.548082+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T04:21:17.548082+0000","last_undegraded":"2023-12-06T04:21:17.548082+0000","last_fullsized":"2023-12-06T04:21:17.548082+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.545971+0000","last_change":"2023-12-06T04:21:17.543728+0000","last_active":"2023-12-06T04:21:17.545971+0000","last_peered":"2023-12-06T04:21:17.545971+0000","last_clean":"2023-12-06T04:21:17.545971+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T04:21:17.545971+0000","last_undegraded":"2023-12-06T04:21:17.545971+0000","last_fullsized":"2023-12-06T04:21:17.545971+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.545882+0000","last_change":"2023-12-06T04:21:17.543136+0000","last_active":"2023-12-06T04:21:17.545882+0000","last_peered":"2023-12-06T04:21:17.545882+0000","last_clean":"2023-12-06T04:21:17.545882+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T04:21:17.545882+0000","last_undegraded":"2023-12-06T04:21:17.545882+0000","last_fullsized":"2023-12-06T04:21:17.545882+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548065+0000","last_change":"2023-12-06T04:21:17.543910+0000","last_active":"2023-12-06T04:21:17.548065+0000","last_peered":"2023-12-06T04:21:17.548065+0000","last_clean":"2023-12-06T04:21:17.548065+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T04:21:17.548065+0000","last_undegraded":"2023-12-06T04:21:17.548065+0000","last_fullsized":"2023-12-06T04:21:17.548065+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548160+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T04:21:17.548160+0000","last_peered":"2023-12-06T04:21:17.548160+0000","last_clean":"2023-12-06T04:21:17.548160+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T04:21:17.548160+0000","last_undegraded":"2023-12-06T04:21:17.548160+0000","last_fullsized":"2023-12-06T04:21:17.548160+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.544419+0000","last_change":"2023-12-06T04:21:17.542924+0000","last_active":"2023-12-06T04:21:17.544419+0000","last_peered":"2023-12-06T04:21:17.544419+0000","last_clean":"2023-12-06T04:21:17.544419+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T04:21:17.544419+0000","last_undegraded":"2023-12-06T04:21:17.544419+0000","last_fullsized":"2023-12-06T04:21:17.544419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.544060+0000","last_change":"2023-12-06T04:21:17.543206+0000","last_active":"2023-12-06T04:21:17.544060+0000","last_peered":"2023-12-06T04:21:17.544060+0000","last_clean":"2023-12-06T04:21:17.544060+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T04:21:17.544060+0000","last_undegraded":"2023-12-06T04:21:17.544060+0000","last_fullsized":"2023-12-06T04:21:17.544060+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548473+0000","last_change":"2023-12-06T04:21:17.545280+0000","last_active":"2023-12-06T04:21:17.548473+0000","last_peered":"2023-12-06T04:21:17.548473+0000","last_clean":"2023-12-06T04:21:17.548473+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T04:21:17.548473+0000","last_undegraded":"2023-12-06T04:21:17.548473+0000","last_fullsized":"2023-12-06T04:21:17.548473+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-12-06T04:21:17.548167+0000","last_change":"2023-12-06T04:21:17.545451+0000","last_active":"2023-12-06T04:21:17.548167+0000","last_peered":"2023-12-06T04:21:17.548167+0000","last_clean":"2023-12-06T04:21:17.548167+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T04:21:17.548167+0000","last_undegraded":"2023-12-06T04:21:17.548167+0000","last_fullsized":"2023-12-06T04:21:17.548167+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297188,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074652,"statfs":{"total":96636764160,"available":96332443648,"internally_reserved":0,"allocated":94208,"data_stored":25688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297188,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074652,"statfs":{"total":96636764160,"available":96332443648,"internally_reserved":0,"allocated":94208,"data_stored":25688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":26808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T04:21:23.056 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-06T04:21:23.056 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-06T04:21:23.056 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-06T04:21:23.056 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-06T04:21:23.376 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T04:21:23.390 INFO:teuthology.orchestra.run.smithi134.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-06T04:21:23.390 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-06T04:21:23.390 INFO:teuthology.run_tasks:Running task exec... 2023-12-06T04:21:23.400 INFO:teuthology.task.exec:Executing custom commands... 2023-12-06T04:21:23.400 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T04:21:23.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-12-06T04:21:24.571 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cache' created 2023-12-06T04:21:24.586 DEBUG:teuthology.orchestra.run.smithi134:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2023-12-06T04:21:25.572 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2023-12-06T04:21:25.587 DEBUG:teuthology.orchestra.run.smithi134:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-12-06T04:21:26.579 INFO:teuthology.orchestra.run.smithi134.stderr:set cache-mode for pool 'cache' to writeback 2023-12-06T04:21:26.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2023-12-06T04:21:27.583 INFO:teuthology.orchestra.run.smithi134.stderr:overlay for 'rbd' is now (or already was) 'cache' 2023-12-06T04:21:27.597 DEBUG:teuthology.orchestra.run.smithi134:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-12-06T04:21:28.586 INFO:teuthology.orchestra.run.smithi134.stderr:set pool 3 hit_set_type to bloom 2023-12-06T04:21:28.599 DEBUG:teuthology.orchestra.run.smithi134:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-12-06T04:21:29.587 INFO:teuthology.orchestra.run.smithi134.stderr:set pool 3 hit_set_count to 8 2023-12-06T04:21:29.601 DEBUG:teuthology.orchestra.run.smithi134:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2023-12-06T04:21:30.591 INFO:teuthology.orchestra.run.smithi134.stderr:set pool 3 hit_set_period to 60 2023-12-06T04:21:30.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2023-12-06T04:21:31.596 INFO:teuthology.orchestra.run.smithi134.stderr:set pool 3 target_max_objects to 250 2023-12-06T04:21:31.610 INFO:teuthology.run_tasks:Running task workunit... 2023-12-06T04:21:31.621 INFO:tasks.workunit:Pulling workunits from ref d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T04:21:31.622 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-12-06T04:21:31.622 DEBUG:teuthology.orchestra.run.smithi134:> stat -- /home/ubuntu/cephtest/mnt.0 2023-12-06T04:21:31.642 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T04:21:31.642 INFO:teuthology.orchestra.run.smithi134.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-12-06T04:21:31.643 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-12-06T04:21:31.702 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-12-06T04:21:31.703 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-12-06T04:21:31.761 INFO:tasks.workunit:timeout=3h 2023-12-06T04:21:31.762 INFO:tasks.workunit:cleanup=True 2023-12-06T04:21:31.762 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d03fca4f35d43f61b4679936aef7bd2f01cced0b 2023-12-06T04:21:31.821 INFO:tasks.workunit.client.0.smithi134.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-12-06T04:22:16.644 INFO:tasks.workunit.client.0.smithi134.stderr:Note: switching to 'd03fca4f35d43f61b4679936aef7bd2f01cced0b'. 2023-12-06T04:22:16.645 INFO:tasks.workunit.client.0.smithi134.stderr: 2023-12-06T04:22:16.645 INFO:tasks.workunit.client.0.smithi134.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-12-06T04:22:16.645 INFO:tasks.workunit.client.0.smithi134.stderr:changes and commit them, and you can discard any commits you make in this 2023-12-06T04:22:16.645 INFO:tasks.workunit.client.0.smithi134.stderr:state without impacting any branches by switching back to a branch. 2023-12-06T04:22:16.645 INFO:tasks.workunit.client.0.smithi134.stderr: 2023-12-06T04:22:16.645 INFO:tasks.workunit.client.0.smithi134.stderr:If you want to create a new branch to retain commits you create, you may 2023-12-06T04:22:16.645 INFO:tasks.workunit.client.0.smithi134.stderr:do so (now or later) by using -c with the switch command. Example: 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr: 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr: git switch -c 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr: 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr:Or undo this operation with: 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr: 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr: git switch - 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr: 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr: 2023-12-06T04:22:16.646 INFO:tasks.workunit.client.0.smithi134.stderr:HEAD is now at d03fca4f35d Merge branch 'wip-ifed-fix-63606' of https://github.com/ifed01/ceph into wip-yuri6-testing-2023-12-05-0753-pacific 2023-12-06T04:22:16.649 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-12-06T04:22:16.715 INFO:tasks.workunit.client.0.smithi134.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-12-06T04:22:16.717 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-06T04:22:16.717 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-12-06T04:22:17.261 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-12-06T04:22:17.318 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-12-06T04:22:17.355 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-12-06T04:22:17.356 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-06T04:22:17.356 INFO:tasks.workunit.client.0.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-12-06T04:22:17.393 INFO:tasks.workunit.client.0.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-12-06T04:22:17.395 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-12-06T04:22:17.395 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-12-06T04:22:17.453 INFO:tasks.workunit:Running workunits matching rbd/cli_generic.sh on client.0... 2023-12-06T04:22:17.454 INFO:tasks.workunit:Running workunit rbd/cli_generic.sh... 2023-12-06T04:22:17.455 DEBUG:teuthology.orchestra.run.smithi134:workunit test rbd/cli_generic.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d03fca4f35d43f61b4679936aef7bd2f01cced0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-12-06T04:22:17.515 INFO:tasks.workunit.client.0.smithi134.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-12-06T04:22:17.517 INFO:tasks.workunit.client.0.smithi134.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2023-12-06T04:22:17.517 INFO:tasks.workunit.client.0.smithi134.stderr:++ TIMEOUT=300 2023-12-06T04:22:17.517 INFO:tasks.workunit.client.0.smithi134.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2023-12-06T04:22:17.517 INFO:tasks.workunit.client.0.smithi134.stderr:++ MAX_TIMEOUT=15 2023-12-06T04:22:17.517 INFO:tasks.workunit.client.0.smithi134.stderr:++ PG_NUM=4 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:++ TMPDIR=/tmp 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:++ TESTDIR=/home/ubuntu/cephtest 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:++ type xmlstarlet 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:++ XMLSTARLET=xmlstarlet 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:+++ uname 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:++ '[' Linux = FreeBSD ']' 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:++ SED=sed 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:++ AWK=awk 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:+++ stty -a 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:+++ head -1 2023-12-06T04:22:17.518 INFO:tasks.workunit.client.0.smithi134.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2023-12-06T04:22:17.519 INFO:tasks.workunit.client.0.smithi134.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-12-06T04:22:17.519 INFO:tasks.workunit.client.0.smithi134.stderr:++ termwidth= 2023-12-06T04:22:17.519 INFO:tasks.workunit.client.0.smithi134.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2023-12-06T04:22:17.519 INFO:tasks.workunit.client.0.smithi134.stderr:++ DIFFCOLOPTS='-y ' 2023-12-06T04:22:17.519 INFO:tasks.workunit.client.0.smithi134.stderr:++ KERNCORE=kernel.core_pattern 2023-12-06T04:22:17.519 INFO:tasks.workunit.client.0.smithi134.stderr:++ EXTRA_OPTS= 2023-12-06T04:22:17.524 INFO:tasks.workunit.client.0.smithi134.stderr:++ test '' = TESTS 2023-12-06T04:22:17.524 INFO:tasks.workunit.client.0.smithi134.stderr:+ export RBD_FORCE_ALLOW_V1=1 2023-12-06T04:22:17.524 INFO:tasks.workunit.client.0.smithi134.stderr:+ RBD_FORCE_ALLOW_V1=1 2023-12-06T04:22:17.524 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:17.524 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:17.524 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v '^0$' 2023-12-06T04:22:17.561 INFO:tasks.workunit.client.0.smithi134.stderr:+ IMGS='testimg1 testimg2 testimg3 testimg4 testimg5 testimg6 testimg-diff1 testimg-diff2 testimg-diff3 foo foo2 bar bar2 test1 test2 test3 test4 clone2' 2023-12-06T04:22:17.562 INFO:tasks.workunit.client.0.smithi134.stderr:+ tiered=0 2023-12-06T04:22:17.562 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd dump 2023-12-06T04:22:17.562 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^pool' 2023-12-06T04:22:17.562 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep ''\''rbd'\''' 2023-12-06T04:22:17.562 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep tier 2023-12-06T04:22:17.944 INFO:tasks.workunit.client.0.smithi134.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 lfor 15/15/15 flags hashpspool tiers 3 read_tier 3 write_tier 3 stripe_width 0 application rbd 2023-12-06T04:22:17.944 INFO:tasks.workunit.client.0.smithi134.stderr:+ tiered=1 2023-12-06T04:22:17.950 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_pool_image_args 2023-12-06T04:22:17.951 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing pool and image args...' 2023-12-06T04:22:17.952 INFO:tasks.workunit.client.0.smithi134.stdout:testing pool and image args... 2023-12-06T04:22:17.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:22:17.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.022 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.088 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.153 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.220 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.296 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.368 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.439 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.507 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.574 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.642 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.708 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.785 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.856 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.922 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:18.997 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:19.071 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:19.144 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:19.217 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-12-06T04:22:19.591 INFO:tasks.workunit.client.0.smithi134.stderr:pool 'test' does not exist 2023-12-06T04:22:19.601 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd pool create test 32 2023-12-06T04:22:20.758 INFO:tasks.workunit.client.0.smithi134.stderr:pool 'test' already exists 2023-12-06T04:22:20.767 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd pool init test 2023-12-06T04:22:23.660 INFO:tasks.workunit.client.0.smithi134.stderr:+ truncate -s 1 /tmp/empty /tmp/empty@snap 2023-12-06T04:22:23.676 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:23.676 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:23.676 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:22:23.703 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:22:23.703 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 1 test1 2023-12-06T04:22:23.731 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:23.729+0000 7ff69972b380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:25.667 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:25.668 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test1 2023-12-06T04:22:25.697 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import --image test2 /tmp/empty 2023-12-06T04:22:25.724 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:25.723+0000 7f2f3cd4e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:25.736 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:25.736 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: --image is deprecated, use --dest 2023-12-06T04:22:25.739 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:25.739 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test2 2023-12-06T04:22:25.766 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --dest test3 import /tmp/empty 2023-12-06T04:22:25.792 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:25.791+0000 7fa034c9c380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:25.802 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:25.805 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:25.805 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test3 2023-12-06T04:22:25.830 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import /tmp/empty foo 2023-12-06T04:22:25.856 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:25.854+0000 7f6347fd7380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:25.866 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:25.869 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:25.870 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q foo 2023-12-06T04:22:25.894 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import --dest test/empty@snap /tmp/empty 2023-12-06T04:22:25.914 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-12-06T04:22:25.915 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:22:25.915 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import /tmp/empty test/empty@snap 2023-12-06T04:22:25.934 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-12-06T04:22:25.936 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:22:25.936 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import --image test/empty@snap /tmp/empty 2023-12-06T04:22:25.956 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-12-06T04:22:25.956 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: --image is deprecated, use --dest 2023-12-06T04:22:25.957 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:22:25.957 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import /tmp/empty@snap 2023-12-06T04:22:25.975 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-12-06T04:22:25.976 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:22:25.977 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:25.977 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:25.977 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:22:26.003 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:22:26.004 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import /tmp/empty test/test1 2023-12-06T04:22:26.029 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:26.027+0000 7fe8b621e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:27.693 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:27.696 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:27.696 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test1 2023-12-06T04:22:27.726 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd -p test import /tmp/empty test2 2023-12-06T04:22:27.754 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:27.753+0000 7f7e0e0a1380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:27.766 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:27.766 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T04:22:27.769 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:27.769 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test2 2023-12-06T04:22:27.796 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --image test3 -p test import /tmp/empty 2023-12-06T04:22:27.824 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:27.823+0000 7f26fc966380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:27.835 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:27.835 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: --image is deprecated, use --dest 2023-12-06T04:22:27.835 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T04:22:27.838 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:27.838 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test3 2023-12-06T04:22:27.864 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --image test4 -p test import /tmp/empty 2023-12-06T04:22:27.892 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:27.891+0000 7f5ad9282380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:27.900 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:27.901 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: --image is deprecated, use --dest 2023-12-06T04:22:27.901 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T04:22:27.903 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:27.903 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test4 2023-12-06T04:22:27.929 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --dest test5 -p test import /tmp/empty 2023-12-06T04:22:27.957 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:27.956+0000 7f2529c36380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:27.965 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:27.966 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T04:22:27.968 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:27.968 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test5 2023-12-06T04:22:27.994 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --dest test6 --dest-pool test import /tmp/empty 2023-12-06T04:22:28.022 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:28.020+0000 7efc9c3de380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:28.030 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:28.033 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:28.033 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test6 2023-12-06T04:22:28.060 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --image test7 --dest-pool test import /tmp/empty 2023-12-06T04:22:28.088 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:28.086+0000 7f55ebf14380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:28.096 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:28.096 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: --image is deprecated, use --dest 2023-12-06T04:22:28.099 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:28.099 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test7 2023-12-06T04:22:28.125 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --image test/test8 import /tmp/empty 2023-12-06T04:22:28.151 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:28.149+0000 7f410a35f380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:28.159 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:28.159 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: --image is deprecated, use --dest 2023-12-06T04:22:28.162 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:28.162 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test8 2023-12-06T04:22:28.188 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --dest test/test9 import /tmp/empty 2023-12-06T04:22:28.214 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:28.213+0000 7f12de603380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:28.223 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:28.226 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:28.226 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test9 2023-12-06T04:22:28.252 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import --pool test /tmp/empty 2023-12-06T04:22:28.278 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:28.277+0000 7fba8a460380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:28.287 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:22:28.287 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-12-06T04:22:28.290 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:28.290 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q empty 2023-12-06T04:22:28.316 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy test/test9 test10 2023-12-06T04:22:29.709 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:22:29.713 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:29.713 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -qv test10 2023-12-06T04:22:29.742 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:29.742 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test10 2023-12-06T04:22:29.769 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy test/test9 test/test10 2023-12-06T04:22:29.817 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:22:29.820 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:29.821 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test10 2023-12-06T04:22:29.846 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy --pool test test10 --dest-pool test test11 2023-12-06T04:22:29.899 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:22:29.902 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:29.902 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -q test11 2023-12-06T04:22:29.928 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy --dest-pool rbd --pool test test11 test12 2023-12-06T04:22:29.983 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:22:29.986 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:29.986 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test12 2023-12-06T04:22:30.011 INFO:tasks.workunit.client.0.smithi134.stdout:test12 2023-12-06T04:22:30.012 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls test 2023-12-06T04:22:30.012 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -qv test12 2023-12-06T04:22:30.038 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -f /tmp/empty /tmp/empty@snap 2023-12-06T04:22:30.038 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-12-06T04:22:30.800 INFO:tasks.workunit.client.0.smithi134.stderr:pool 'test' does not exist 2023-12-06T04:22:30.809 INFO:tasks.workunit.client.0.smithi134.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T04:22:30.809 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm foo 2023-12-06T04:22:30.848 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:30.850 INFO:tasks.workunit.client.0.smithi134.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T04:22:30.851 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:22:30.884 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:30.887 INFO:tasks.workunit.client.0.smithi134.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T04:22:30.887 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test10 2023-12-06T04:22:30.950 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:30.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T04:22:30.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test12 2023-12-06T04:22:31.015 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:31.017 INFO:tasks.workunit.client.0.smithi134.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T04:22:31.017 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:22:31.057 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:31.059 INFO:tasks.workunit.client.0.smithi134.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-12-06T04:22:31.059 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test3 2023-12-06T04:22:31.092 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:31.095 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_rename 2023-12-06T04:22:31.095 INFO:tasks.workunit.client.0.smithi134.stdout:testing rename... 2023-12-06T04:22:31.095 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing rename...' 2023-12-06T04:22:31.096 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:22:31.096 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.170 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.243 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.309 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.382 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.454 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.526 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.593 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.659 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.728 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.795 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.861 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.927 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:31.993 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:32.059 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:32.125 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:32.192 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:32.260 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:32.332 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 1 -s 1 foo 2023-12-06T04:22:32.354 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:22:32.361 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:32.359+0000 7fe82d725380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:32.366 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 bar 2023-12-06T04:22:32.406 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rename foo foo2 2023-12-06T04:22:32.447 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rename foo2 bar 2023-12-06T04:22:32.447 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep exists 2023-12-06T04:22:32.481 INFO:tasks.workunit.client.0.smithi134.stdout:2023-12-06T04:22:32.476+0000 7f87addb4380 -1 librbd::Operations: rbd image bar already exists 2023-12-06T04:22:32.481 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: rename error: (17) File exists 2023-12-06T04:22:32.482 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rename bar bar2 2023-12-06T04:22:32.532 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rename bar2 foo2 2023-12-06T04:22:32.533 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep exists 2023-12-06T04:22:32.567 INFO:tasks.workunit.client.0.smithi134.stdout:2023-12-06T04:22:32.562+0000 7fe1f7310380 -1 librbd::Operations: rbd image foo2 already exists 2023-12-06T04:22:32.567 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: rename error: (17) File exists 2023-12-06T04:22:32.567 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd pool create rbd2 8 2023-12-06T04:22:33.803 INFO:tasks.workunit.client.0.smithi134.stderr:pool 'rbd2' already exists 2023-12-06T04:22:33.813 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd pool init rbd2 2023-12-06T04:22:36.706 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -p rbd2 -s 1 foo 2023-12-06T04:22:36.738 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:36.736+0000 7f43d93c3380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:38.541 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rename rbd2/foo rbd2/bar 2023-12-06T04:22:38.586 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd -p rbd2 ls 2023-12-06T04:22:38.587 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep bar 2023-12-06T04:22:38.615 INFO:tasks.workunit.client.0.smithi134.stdout:bar 2023-12-06T04:22:38.615 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rename rbd2/bar foo 2023-12-06T04:22:38.658 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rename --pool rbd2 foo bar 2023-12-06T04:22:38.704 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rename rbd2/bar --dest-pool rbd foo 2023-12-06T04:22:38.725 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: mv/rename across pools not supported 2023-12-06T04:22:38.725 INFO:tasks.workunit.client.0.smithi134.stderr:source pool: rbd2 dest pool: rbd 2023-12-06T04:22:38.726 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rename --pool rbd2 bar --dest-pool rbd2 foo 2023-12-06T04:22:38.771 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd -p rbd2 ls 2023-12-06T04:22:38.773 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep foo 2023-12-06T04:22:38.798 INFO:tasks.workunit.client.0.smithi134.stdout:foo 2023-12-06T04:22:38.798 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-12-06T04:22:39.816 INFO:tasks.workunit.client.0.smithi134.stderr:pool 'rbd2' does not exist 2023-12-06T04:22:39.825 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:22:39.826 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:39.902 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:39.968 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:40.032 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:40.098 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:40.169 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:40.240 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:40.306 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:40.372 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:40.639 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.113 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.188 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.261 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.409 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.476 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.545 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.611 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.677 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.743 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_ls 2023-12-06T04:22:41.743 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing ls...' 2023-12-06T04:22:41.744 INFO:tasks.workunit.client.0.smithi134.stdout:testing ls... 2023-12-06T04:22:41.744 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:22:41.744 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.812 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:41.886 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.159 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.231 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.302 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.373 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.446 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.517 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.589 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.656 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.726 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.793 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.861 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.926 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:42.992 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:43.061 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:43.131 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:43.202 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 1 -s 1 test1 2023-12-06T04:22:43.224 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:22:43.229 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:43.228+0000 7fb4d9e81380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:43.235 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 1 -s 1 test2 2023-12-06T04:22:43.257 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:22:43.262 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:43.261+0000 7f713ffa0380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:43.269 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:43.269 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:22:43.293 INFO:tasks.workunit.client.0.smithi134.stdout:test1 2023-12-06T04:22:43.293 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:43.293 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test2 2023-12-06T04:22:43.319 INFO:tasks.workunit.client.0.smithi134.stdout:test2 2023-12-06T04:22:43.319 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:43.319 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:43.319 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:22:43.345 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:22:43.345 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:22:43.345 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test1.*1 MiB.*1' 2023-12-06T04:22:43.381 INFO:tasks.workunit.client.0.smithi134.stdout:test1 1 MiB 1 2023-12-06T04:22:43.381 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:22:43.381 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test2.*1 MiB.*1' 2023-12-06T04:22:43.412 INFO:tasks.workunit.client.0.smithi134.stdout:test2 1 MiB 1 2023-12-06T04:22:43.412 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:22:43.448 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:43.450 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:22:43.489 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:43.491 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T04:22:43.533 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test2 2023-12-06T04:22:43.577 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:43.577 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:22:43.603 INFO:tasks.workunit.client.0.smithi134.stdout:test1 2023-12-06T04:22:43.603 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:43.603 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test2 2023-12-06T04:22:43.629 INFO:tasks.workunit.client.0.smithi134.stdout:test2 2023-12-06T04:22:43.630 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:43.630 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:43.630 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:22:43.655 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:22:43.655 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:22:43.655 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test1.*1 MiB.*2' 2023-12-06T04:22:43.689 INFO:tasks.workunit.client.0.smithi134.stdout:test1 1 MiB 2 2023-12-06T04:22:43.690 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:22:43.690 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test2.*1 MiB.*2' 2023-12-06T04:22:43.724 INFO:tasks.workunit.client.0.smithi134.stdout:test2 1 MiB 2 2023-12-06T04:22:43.724 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:22:43.808 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:43.810 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:22:43.898 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:43.901 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T04:22:43.941 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 1 -s 1 test2 2023-12-06T04:22:43.963 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:22:43.968 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:43.967+0000 7f0a141cd380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:43.974 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:43.974 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:22:43.999 INFO:tasks.workunit.client.0.smithi134.stdout:test1 2023-12-06T04:22:43.999 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:43.999 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test2 2023-12-06T04:22:44.025 INFO:tasks.workunit.client.0.smithi134.stdout:test2 2023-12-06T04:22:44.026 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:44.026 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:44.026 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:22:44.050 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:22:44.051 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:22:44.051 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test1.*1 MiB.*2' 2023-12-06T04:22:44.085 INFO:tasks.workunit.client.0.smithi134.stdout:test1 1 MiB 2 2023-12-06T04:22:44.085 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:22:44.085 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test2.*1 MiB.*1' 2023-12-06T04:22:44.119 INFO:tasks.workunit.client.0.smithi134.stdout:test2 1 MiB 1 2023-12-06T04:22:44.119 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:22:44.119 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.187 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.261 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.333 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.399 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.466 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.533 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.599 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.666 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.732 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.798 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.863 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:44.933 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:45.007 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:45.146 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:45.218 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:45.286 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:45.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:22:45.428 INFO:tasks.workunit.client.0.smithi134.stderr:++ seq -w 00 99 2023-12-06T04:22:45.439 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.440 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.00 -s 1 2023-12-06T04:22:45.466 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.465+0000 7f2d34a45380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.473 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.473 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.01 -s 1 2023-12-06T04:22:45.500 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.498+0000 7fa0c4cd4380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.509 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.509 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.02 -s 1 2023-12-06T04:22:45.536 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.534+0000 7ff1b2bee380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.541 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.541 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.03 -s 1 2023-12-06T04:22:45.568 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.567+0000 7fa965b4b380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.574 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.574 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.04 -s 1 2023-12-06T04:22:45.600 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.599+0000 7f37ddae1380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.606 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.606 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.05 -s 1 2023-12-06T04:22:45.632 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.631+0000 7f2fa2f53380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.637 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.637 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.06 -s 1 2023-12-06T04:22:45.664 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.663+0000 7f5f1dcfa380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.674 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.674 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.07 -s 1 2023-12-06T04:22:45.701 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.699+0000 7fe214266380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.713 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.713 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.08 -s 1 2023-12-06T04:22:45.739 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.738+0000 7f039e1a2380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.747 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.747 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.09 -s 1 2023-12-06T04:22:45.773 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.772+0000 7f15ec315380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.780 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.780 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.10 -s 1 2023-12-06T04:22:45.807 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.805+0000 7f7f17f7f380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.813 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.813 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.11 -s 1 2023-12-06T04:22:45.839 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.838+0000 7f1bb25fa380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.845 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.845 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.12 -s 1 2023-12-06T04:22:45.871 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.870+0000 7ff320e58380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.13 -s 1 2023-12-06T04:22:45.904 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.902+0000 7f960186b380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.910 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.910 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.14 -s 1 2023-12-06T04:22:45.936 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.935+0000 7f7eb64e2380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.944 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.944 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.15 -s 1 2023-12-06T04:22:45.970 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:45.969+0000 7fb9e8255380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:45.978 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:45.978 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.16 -s 1 2023-12-06T04:22:46.004 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.003+0000 7fa58f602380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.010 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.010 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.17 -s 1 2023-12-06T04:22:46.037 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.035+0000 7f4506e2f380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.047 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.047 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.18 -s 1 2023-12-06T04:22:46.074 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.072+0000 7f0d0df83380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.083 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.083 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.19 -s 1 2023-12-06T04:22:46.109 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.108+0000 7fe6dcccc380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.120 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.120 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.20 -s 1 2023-12-06T04:22:46.147 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.145+0000 7f1965e9c380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.157 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.157 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.21 -s 1 2023-12-06T04:22:46.185 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.183+0000 7f3fb0b18380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.195 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.195 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.22 -s 1 2023-12-06T04:22:46.222 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.221+0000 7f0d8cd08380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.233 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.233 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.23 -s 1 2023-12-06T04:22:46.259 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.258+0000 7f9c88fc4380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.265 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.266 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.24 -s 1 2023-12-06T04:22:46.493 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.491+0000 7f04a7d22380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.500 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.500 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.25 -s 1 2023-12-06T04:22:46.526 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.525+0000 7f79c1a89380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.532 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.532 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.26 -s 1 2023-12-06T04:22:46.558 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.557+0000 7fdc2535e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.564 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.565 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.27 -s 1 2023-12-06T04:22:46.591 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.590+0000 7fb1a05c5380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.597 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.597 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.28 -s 1 2023-12-06T04:22:46.623 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.622+0000 7f351ead3380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.629 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.629 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.29 -s 1 2023-12-06T04:22:46.655 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.654+0000 7f02a2f40380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.661 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.661 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.30 -s 1 2023-12-06T04:22:46.687 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.686+0000 7f65d40e3380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.695 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.695 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.31 -s 1 2023-12-06T04:22:46.721 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.720+0000 7efdc3955380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.727 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.727 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.32 -s 1 2023-12-06T04:22:46.754 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.752+0000 7f6bd1596380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.763 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.763 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.33 -s 1 2023-12-06T04:22:46.789 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:46.787+0000 7f117bfd1380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:46.798 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:46.798 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.34 -s 1 2023-12-06T04:22:47.024 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.023+0000 7fe099863380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.035 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.036 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.35 -s 1 2023-12-06T04:22:47.062 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.061+0000 7ff530699380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.073 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.073 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.36 -s 1 2023-12-06T04:22:47.099 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.098+0000 7f4faf4e8380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.106 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.106 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.37 -s 1 2023-12-06T04:22:47.133 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.131+0000 7f3f8e0f4380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.141 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.141 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.38 -s 1 2023-12-06T04:22:47.168 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.167+0000 7ff3cb450380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.178 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.179 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.39 -s 1 2023-12-06T04:22:47.206 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.204+0000 7f246859e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.40 -s 1 2023-12-06T04:22:47.242 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.241+0000 7faa7ae9a380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.253 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.253 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.41 -s 1 2023-12-06T04:22:47.279 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.278+0000 7f5e7c54a380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.287 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.287 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.42 -s 1 2023-12-06T04:22:47.313 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.312+0000 7fd20305e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.323 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.323 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.43 -s 1 2023-12-06T04:22:47.349 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.348+0000 7f6d3cc28380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.357 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.358 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.44 -s 1 2023-12-06T04:22:47.384 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.382+0000 7f891192e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.389 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.389 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.45 -s 1 2023-12-06T04:22:47.416 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.415+0000 7fdf45c91380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.422 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.422 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.46 -s 1 2023-12-06T04:22:47.449 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.448+0000 7fa4d41c6380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.455 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.455 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.47 -s 1 2023-12-06T04:22:47.485 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.483+0000 7f6ea5962380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.490 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.490 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.48 -s 1 2023-12-06T04:22:47.517 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.516+0000 7f563914e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.524 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.524 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.49 -s 1 2023-12-06T04:22:47.551 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.549+0000 7f576b058380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.559 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.560 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.50 -s 1 2023-12-06T04:22:47.586 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.585+0000 7f7d71257380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.592 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.592 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.51 -s 1 2023-12-06T04:22:47.619 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.617+0000 7f5f55b7a380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.624 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.624 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.52 -s 1 2023-12-06T04:22:47.650 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.649+0000 7f2ec64c8380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.657 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.657 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.53 -s 1 2023-12-06T04:22:47.683 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.682+0000 7f6592aed380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.688 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.689 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.54 -s 1 2023-12-06T04:22:47.716 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.714+0000 7f59ad166380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.721 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.721 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.55 -s 1 2023-12-06T04:22:47.748 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.746+0000 7f7a02e8d380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.755 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.755 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.56 -s 1 2023-12-06T04:22:47.782 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.780+0000 7f8254741380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.793 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.57 -s 1 2023-12-06T04:22:47.819 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.818+0000 7f963ca9b380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.834 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.834 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.58 -s 1 2023-12-06T04:22:47.861 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.860+0000 7ff7d4977380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.868 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.868 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.59 -s 1 2023-12-06T04:22:47.895 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.893+0000 7f26c0cb9380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.903 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.903 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.60 -s 1 2023-12-06T04:22:47.930 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.928+0000 7f0e7e813380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.937 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.937 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.61 -s 1 2023-12-06T04:22:47.964 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:47.962+0000 7f7dadae9380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:47.977 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:47.977 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.62 -s 1 2023-12-06T04:22:48.003 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.002+0000 7f62169c5380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.013 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.013 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.63 -s 1 2023-12-06T04:22:48.040 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.038+0000 7f5ad365e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.052 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.052 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.64 -s 1 2023-12-06T04:22:48.075 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.074+0000 7f529fa7f380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.081 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.081 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.65 -s 1 2023-12-06T04:22:48.108 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.106+0000 7fc87e70b380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.116 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.116 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.66 -s 1 2023-12-06T04:22:48.144 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.143+0000 7f141c650380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.151 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.151 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.67 -s 1 2023-12-06T04:22:48.178 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.177+0000 7fc325827380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.185 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.185 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.68 -s 1 2023-12-06T04:22:48.213 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.211+0000 7f2f5ae0c380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.221 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.222 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.69 -s 1 2023-12-06T04:22:48.250 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.249+0000 7f227f72d380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.261 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.261 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.70 -s 1 2023-12-06T04:22:48.288 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.287+0000 7f3b35dbc380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.293 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.294 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.71 -s 1 2023-12-06T04:22:48.321 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.320+0000 7efd13802380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.327 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.327 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.72 -s 1 2023-12-06T04:22:48.354 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.353+0000 7f266013a380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.365 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.365 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.73 -s 1 2023-12-06T04:22:48.391 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.390+0000 7f26f28ba380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.405 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.406 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.74 -s 1 2023-12-06T04:22:48.430 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.429+0000 7f7f848cb380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.437 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.437 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.75 -s 1 2023-12-06T04:22:48.464 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.462+0000 7f6458ecc380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.472 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.472 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.76 -s 1 2023-12-06T04:22:48.499 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.498+0000 7f7bd3471380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.509 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.509 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.77 -s 1 2023-12-06T04:22:48.536 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.534+0000 7fcceda11380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.541 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.541 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.78 -s 1 2023-12-06T04:22:48.568 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.567+0000 7fdaab0b0380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.578 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.578 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.79 -s 1 2023-12-06T04:22:48.606 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.604+0000 7f476dc22380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.813 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.813 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.80 -s 1 2023-12-06T04:22:48.842 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.838+0000 7fa6a9c1a380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.846 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.847 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.81 -s 1 2023-12-06T04:22:48.874 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.872+0000 7f9bdbfdf380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.881 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.881 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.82 -s 1 2023-12-06T04:22:48.907 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.906+0000 7f037f57e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.914 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.914 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.83 -s 1 2023-12-06T04:22:48.940 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.939+0000 7ff47576e380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.951 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.951 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.84 -s 1 2023-12-06T04:22:48.975 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:48.974+0000 7f34d4393380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:48.985 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:48.985 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.85 -s 1 2023-12-06T04:22:49.012 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.010+0000 7f48549d4380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.017 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.018 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.86 -s 1 2023-12-06T04:22:49.044 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.043+0000 7ff775df3380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.053 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.054 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.87 -s 1 2023-12-06T04:22:49.081 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.079+0000 7f87f01e0380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.087 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.087 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.88 -s 1 2023-12-06T04:22:49.114 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.112+0000 7f57b9b29380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.124 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.124 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.89 -s 1 2023-12-06T04:22:49.151 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.149+0000 7f8eca747380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.156 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.157 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.90 -s 1 2023-12-06T04:22:49.184 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.182+0000 7f33ab929380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.194 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.195 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.91 -s 1 2023-12-06T04:22:49.221 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.220+0000 7efe38d27380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.230 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.230 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.92 -s 1 2023-12-06T04:22:49.257 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.255+0000 7f7b8dca2380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.263 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.263 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.93 -s 1 2023-12-06T04:22:49.290 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.288+0000 7f102d542380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.298 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.299 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.94 -s 1 2023-12-06T04:22:49.326 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.324+0000 7fcbae7bc380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.332 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.332 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.95 -s 1 2023-12-06T04:22:49.358 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.357+0000 7f3639ae0380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.365 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.365 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.96 -s 1 2023-12-06T04:22:49.392 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.390+0000 7fdab9790380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.403 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.403 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.97 -s 1 2023-12-06T04:22:49.429 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.428+0000 7fcda24bb380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.438 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.438 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.98 -s 1 2023-12-06T04:22:49.465 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.463+0000 7f8a6cdf7380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.475 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.475 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.99 -s 1 2023-12-06T04:22:49.502 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.501+0000 7fcdec897380 -1 librbd: Forced V1 image creation. 2023-12-06T04:22:49.509 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:49.509 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:49.509 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 100 2023-12-06T04:22:49.535 INFO:tasks.workunit.client.0.smithi134.stdout:100 2023-12-06T04:22:49.535 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:22:49.535 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep image 2023-12-06T04:22:49.536 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:49.536 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 100 2023-12-06T04:22:49.606 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.604+0000 7fdea0b1f700 0 -- 172.21.15.134:0/1948475763 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55619df119e0 msgr2=0x55619df11e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:22:49.614 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:49.613+0000 7fdea0b1f700 0 -- 172.21.15.134:0/1948475763 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fde800363a0 msgr2=0x7fde800387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:22:49.779 INFO:tasks.workunit.client.0.smithi134.stdout:100 2023-12-06T04:22:49.779 INFO:tasks.workunit.client.0.smithi134.stderr:++ seq -w 00 99 2023-12-06T04:22:49.780 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.780 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.00 2023-12-06T04:22:49.815 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:49.818 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.818 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.01 2023-12-06T04:22:49.852 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:49.854 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.854 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.02 2023-12-06T04:22:49.893 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:49.895 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.895 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.03 2023-12-06T04:22:49.933 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:49.933 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.933 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.04 2023-12-06T04:22:49.971 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:49.973 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:49.973 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.05 2023-12-06T04:22:50.010 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.012 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.012 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.06 2023-12-06T04:22:50.055 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.057 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.057 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.07 2023-12-06T04:22:50.091 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.093 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.093 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.08 2023-12-06T04:22:50.127 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.130 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.130 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.09 2023-12-06T04:22:50.164 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.167 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.167 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.10 2023-12-06T04:22:50.201 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.203 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.203 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.11 2023-12-06T04:22:50.239 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.241 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.241 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.12 2023-12-06T04:22:50.278 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.280 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.280 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.13 2023-12-06T04:22:50.316 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.318 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.319 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.14 2023-12-06T04:22:50.354 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.356 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.356 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.15 2023-12-06T04:22:50.390 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.392 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.392 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.16 2023-12-06T04:22:50.430 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.432 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.432 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.17 2023-12-06T04:22:50.470 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.472 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.472 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.18 2023-12-06T04:22:50.508 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.510 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.510 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.19 2023-12-06T04:22:50.546 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.548 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.548 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.20 2023-12-06T04:22:50.589 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.591 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.592 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.21 2023-12-06T04:22:50.625 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.628 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.628 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.22 2023-12-06T04:22:50.669 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.672 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.672 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.23 2023-12-06T04:22:50.707 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.709 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.709 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.24 2023-12-06T04:22:50.743 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.746 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.746 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.25 2023-12-06T04:22:50.780 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.783 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.783 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.26 2023-12-06T04:22:50.818 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.820 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.820 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.27 2023-12-06T04:22:50.855 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.858 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.858 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.28 2023-12-06T04:22:50.894 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.897 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.897 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.29 2023-12-06T04:22:50.935 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.937 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.937 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.30 2023-12-06T04:22:50.971 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:50.973 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:50.974 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.31 2023-12-06T04:22:51.012 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.015 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.016 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.32 2023-12-06T04:22:51.249 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.252 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.252 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.33 2023-12-06T04:22:51.488 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.491 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.524 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.34 2023-12-06T04:22:51.530 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.533 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.533 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.35 2023-12-06T04:22:51.574 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.576 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.576 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.36 2023-12-06T04:22:51.614 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.616 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.616 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.37 2023-12-06T04:22:51.652 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.654 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.654 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.38 2023-12-06T04:22:51.874 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:51.874+0000 7feb15da9700 0 --2- 172.21.15.134:0/1080985877 >> v2:172.21.15.134:3300/0 conn(0x564a26f6f700 0x564a27004bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-06T04:22:51.890 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.892 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.892 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.39 2023-12-06T04:22:51.929 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.931 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.931 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.40 2023-12-06T04:22:51.966 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:51.969 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:51.969 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.41 2023-12-06T04:22:52.009 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.011 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.011 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.42 2023-12-06T04:22:52.050 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.053 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.053 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.43 2023-12-06T04:22:52.089 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.094 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.094 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.44 2023-12-06T04:22:52.130 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.132 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.132 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.45 2023-12-06T04:22:52.166 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.168 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.169 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.46 2023-12-06T04:22:52.204 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.206 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.206 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.47 2023-12-06T04:22:52.242 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.245 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.245 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.48 2023-12-06T04:22:52.280 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.282 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.283 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.49 2023-12-06T04:22:52.316 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.319 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.319 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.50 2023-12-06T04:22:52.356 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.358 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.358 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.51 2023-12-06T04:22:52.392 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.395 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.395 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.52 2023-12-06T04:22:52.441 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.443 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.443 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.53 2023-12-06T04:22:52.480 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.483 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.483 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.54 2023-12-06T04:22:52.521 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.523 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.523 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.55 2023-12-06T04:22:52.562 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.565 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.565 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.56 2023-12-06T04:22:52.604 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.606 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.606 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.57 2023-12-06T04:22:52.643 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.646 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.646 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.58 2023-12-06T04:22:52.693 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.695 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.695 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.59 2023-12-06T04:22:52.732 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.735 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.735 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.60 2023-12-06T04:22:52.779 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.782 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.782 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.61 2023-12-06T04:22:52.816 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.819 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.819 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.62 2023-12-06T04:22:52.857 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.859 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.859 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.63 2023-12-06T04:22:52.895 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.898 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.898 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.64 2023-12-06T04:22:52.932 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.935 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.935 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.65 2023-12-06T04:22:52.970 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:52.974 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:52.974 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.66 2023-12-06T04:22:53.005 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.008 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.008 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.67 2023-12-06T04:22:53.045 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.047 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.047 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.68 2023-12-06T04:22:53.091 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.094 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.094 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.69 2023-12-06T04:22:53.131 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.133 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.133 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.70 2023-12-06T04:22:53.168 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.170 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.170 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.71 2023-12-06T04:22:53.205 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.207 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.208 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.72 2023-12-06T04:22:53.244 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.247 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.247 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.73 2023-12-06T04:22:53.294 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.296 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.296 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.74 2023-12-06T04:22:53.334 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.337 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.337 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.75 2023-12-06T04:22:53.373 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.376 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.376 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.76 2023-12-06T04:22:53.410 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.413 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.413 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.77 2023-12-06T04:22:53.448 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.451 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.451 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.78 2023-12-06T04:22:53.485 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.488 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.488 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.79 2023-12-06T04:22:53.524 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.526 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.526 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.80 2023-12-06T04:22:53.563 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.566 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.566 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.81 2023-12-06T04:22:53.607 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.610 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.611 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.82 2023-12-06T04:22:53.645 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.648 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.648 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.83 2023-12-06T04:22:53.685 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.687 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.687 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.84 2023-12-06T04:22:53.724 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.726 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.727 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.85 2023-12-06T04:22:53.765 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.86 2023-12-06T04:22:53.807 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.810 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.810 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.87 2023-12-06T04:22:53.854 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.857 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.857 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.88 2023-12-06T04:22:53.895 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.897 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.897 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.89 2023-12-06T04:22:53.941 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.942 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.942 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.90 2023-12-06T04:22:53.979 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:53.981 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:53.981 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.91 2023-12-06T04:22:54.017 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:54.019 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.020 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.92 2023-12-06T04:22:54.057 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:54.059 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.060 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.93 2023-12-06T04:22:54.104 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:54.105 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.105 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.94 2023-12-06T04:22:54.140 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:54.142 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.145 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.95 2023-12-06T04:22:54.184 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:54.186 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.187 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.96 2023-12-06T04:22:54.235 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:54.237 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.238 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.97 2023-12-06T04:22:54.274 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:54.277 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.277 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.98 2023-12-06T04:22:54.314 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:54.318 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.318 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.99 2023-12-06T04:22:54.354 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:54.355 INFO:tasks.workunit.client.0.smithi134.stderr:++ seq -w 00 99 2023-12-06T04:22:54.356 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.356 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.00 --image-format 2 -s 1 2023-12-06T04:22:54.397 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.397 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.01 --image-format 2 -s 1 2023-12-06T04:22:54.439 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.439 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.02 --image-format 2 -s 1 2023-12-06T04:22:54.483 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.483 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.03 --image-format 2 -s 1 2023-12-06T04:22:54.523 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.524 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.04 --image-format 2 -s 1 2023-12-06T04:22:54.564 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.564 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.05 --image-format 2 -s 1 2023-12-06T04:22:54.606 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.606 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.06 --image-format 2 -s 1 2023-12-06T04:22:54.646 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.646 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.07 --image-format 2 -s 1 2023-12-06T04:22:54.692 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.692 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.08 --image-format 2 -s 1 2023-12-06T04:22:54.732 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.733 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.09 --image-format 2 -s 1 2023-12-06T04:22:54.974 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:54.974 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.10 --image-format 2 -s 1 2023-12-06T04:22:55.011 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.011 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.11 --image-format 2 -s 1 2023-12-06T04:22:55.055 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.055 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.12 --image-format 2 -s 1 2023-12-06T04:22:55.095 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.095 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.13 --image-format 2 -s 1 2023-12-06T04:22:55.136 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.136 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.14 --image-format 2 -s 1 2023-12-06T04:22:55.184 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.184 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.15 --image-format 2 -s 1 2023-12-06T04:22:55.226 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.226 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.16 --image-format 2 -s 1 2023-12-06T04:22:55.268 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.268 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.17 --image-format 2 -s 1 2023-12-06T04:22:55.495 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:55.495+0000 7f7ae7731700 0 --2- 172.21.15.134:0/260886639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562d7d08fc10 0x562d7d08b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-06T04:22:55.514 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.515 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.18 --image-format 2 -s 1 2023-12-06T04:22:55.558 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.558 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.19 --image-format 2 -s 1 2023-12-06T04:22:55.599 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.599 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.20 --image-format 2 -s 1 2023-12-06T04:22:55.642 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.643 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.21 --image-format 2 -s 1 2023-12-06T04:22:55.687 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.687 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.22 --image-format 2 -s 1 2023-12-06T04:22:55.736 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.736 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.23 --image-format 2 -s 1 2023-12-06T04:22:55.782 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.782 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.24 --image-format 2 -s 1 2023-12-06T04:22:55.831 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.831 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.25 --image-format 2 -s 1 2023-12-06T04:22:55.869 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.869 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.26 --image-format 2 -s 1 2023-12-06T04:22:55.910 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.910 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.27 --image-format 2 -s 1 2023-12-06T04:22:55.962 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:55.962 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.28 --image-format 2 -s 1 2023-12-06T04:22:56.003 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.003 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.29 --image-format 2 -s 1 2023-12-06T04:22:56.045 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.045 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.30 --image-format 2 -s 1 2023-12-06T04:22:56.086 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.086 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.31 --image-format 2 -s 1 2023-12-06T04:22:56.130 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.130 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.32 --image-format 2 -s 1 2023-12-06T04:22:56.170 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.170 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.33 --image-format 2 -s 1 2023-12-06T04:22:56.216 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.216 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.34 --image-format 2 -s 1 2023-12-06T04:22:56.258 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.258 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.35 --image-format 2 -s 1 2023-12-06T04:22:56.299 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.299 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.36 --image-format 2 -s 1 2023-12-06T04:22:56.342 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.342 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.37 --image-format 2 -s 1 2023-12-06T04:22:56.390 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.390 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.38 --image-format 2 -s 1 2023-12-06T04:22:56.432 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.432 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.39 --image-format 2 -s 1 2023-12-06T04:22:56.477 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.478 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.40 --image-format 2 -s 1 2023-12-06T04:22:56.531 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.531 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.41 --image-format 2 -s 1 2023-12-06T04:22:56.571 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.572 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.42 --image-format 2 -s 1 2023-12-06T04:22:56.611 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.611 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.43 --image-format 2 -s 1 2023-12-06T04:22:56.655 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.656 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.44 --image-format 2 -s 1 2023-12-06T04:22:56.699 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.699 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.45 --image-format 2 -s 1 2023-12-06T04:22:56.741 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.741 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.46 --image-format 2 -s 1 2023-12-06T04:22:56.780 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.780 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.47 --image-format 2 -s 1 2023-12-06T04:22:56.832 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.832 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.48 --image-format 2 -s 1 2023-12-06T04:22:56.885 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.885 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.49 --image-format 2 -s 1 2023-12-06T04:22:56.939 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.939 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.50 --image-format 2 -s 1 2023-12-06T04:22:56.984 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:56.984 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.51 --image-format 2 -s 1 2023-12-06T04:22:57.030 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.030 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.52 --image-format 2 -s 1 2023-12-06T04:22:57.076 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.076 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.53 --image-format 2 -s 1 2023-12-06T04:22:57.117 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.117 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.54 --image-format 2 -s 1 2023-12-06T04:22:57.156 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.156 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.55 --image-format 2 -s 1 2023-12-06T04:22:57.197 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.197 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.56 --image-format 2 -s 1 2023-12-06T04:22:57.240 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.241 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.57 --image-format 2 -s 1 2023-12-06T04:22:57.282 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.282 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.58 --image-format 2 -s 1 2023-12-06T04:22:57.324 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.325 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.59 --image-format 2 -s 1 2023-12-06T04:22:57.377 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.377 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.60 --image-format 2 -s 1 2023-12-06T04:22:57.418 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.418 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.61 --image-format 2 -s 1 2023-12-06T04:22:57.461 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.461 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.62 --image-format 2 -s 1 2023-12-06T04:22:57.505 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.505 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.63 --image-format 2 -s 1 2023-12-06T04:22:57.543 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.544 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.64 --image-format 2 -s 1 2023-12-06T04:22:57.591 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.591 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.65 --image-format 2 -s 1 2023-12-06T04:22:57.631 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.631 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.66 --image-format 2 -s 1 2023-12-06T04:22:57.671 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.671 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.67 --image-format 2 -s 1 2023-12-06T04:22:57.710 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.711 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.68 --image-format 2 -s 1 2023-12-06T04:22:57.752 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.752 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.69 --image-format 2 -s 1 2023-12-06T04:22:57.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.70 --image-format 2 -s 1 2023-12-06T04:22:57.841 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.841 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.71 --image-format 2 -s 1 2023-12-06T04:22:57.887 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.888 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.72 --image-format 2 -s 1 2023-12-06T04:22:57.932 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.932 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.73 --image-format 2 -s 1 2023-12-06T04:22:57.971 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:57.971 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.74 --image-format 2 -s 1 2023-12-06T04:22:58.012 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.013 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.75 --image-format 2 -s 1 2023-12-06T04:22:58.057 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.058 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.76 --image-format 2 -s 1 2023-12-06T04:22:58.099 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.099 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.77 --image-format 2 -s 1 2023-12-06T04:22:58.143 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.143 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.78 --image-format 2 -s 1 2023-12-06T04:22:58.184 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.184 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.79 --image-format 2 -s 1 2023-12-06T04:22:58.225 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.225 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.80 --image-format 2 -s 1 2023-12-06T04:22:58.277 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.277 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.81 --image-format 2 -s 1 2023-12-06T04:22:58.317 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.318 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.82 --image-format 2 -s 1 2023-12-06T04:22:58.361 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.361 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.83 --image-format 2 -s 1 2023-12-06T04:22:58.412 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.412 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.84 --image-format 2 -s 1 2023-12-06T04:22:58.455 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.455 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.85 --image-format 2 -s 1 2023-12-06T04:22:58.499 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.499 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.86 --image-format 2 -s 1 2023-12-06T04:22:58.540 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.541 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.87 --image-format 2 -s 1 2023-12-06T04:22:58.583 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.583 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.88 --image-format 2 -s 1 2023-12-06T04:22:58.627 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.627 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.89 --image-format 2 -s 1 2023-12-06T04:22:58.670 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.670 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.90 --image-format 2 -s 1 2023-12-06T04:22:58.714 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.714 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.91 --image-format 2 -s 1 2023-12-06T04:22:58.757 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.757 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.92 --image-format 2 -s 1 2023-12-06T04:22:58.798 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.798 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.93 --image-format 2 -s 1 2023-12-06T04:22:58.842 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.843 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.94 --image-format 2 -s 1 2023-12-06T04:22:58.884 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.884 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.95 --image-format 2 -s 1 2023-12-06T04:22:58.934 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.934 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.96 --image-format 2 -s 1 2023-12-06T04:22:58.979 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:58.979 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.97 --image-format 2 -s 1 2023-12-06T04:22:59.023 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:59.024 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.98 --image-format 2 -s 1 2023-12-06T04:22:59.066 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:59.067 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create image.99 --image-format 2 -s 1 2023-12-06T04:22:59.107 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:22:59.107 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:59.107 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 100 2023-12-06T04:22:59.133 INFO:tasks.workunit.client.0.smithi134.stdout:100 2023-12-06T04:22:59.134 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:22:59.134 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep image 2023-12-06T04:22:59.134 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:22:59.134 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 100 2023-12-06T04:22:59.184 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:59.184+0000 7fb7589be700 0 -- 172.21.15.134:0/1693274110 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fb7380363a0 msgr2=0x7fb7380387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:22:59.188 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:22:59.188+0000 7fb7591bf700 0 -- 172.21.15.134:0/1693274110 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x56071a588f10 msgr2=0x56071a5875c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:22:59.447 INFO:tasks.workunit.client.0.smithi134.stdout:100 2023-12-06T04:22:59.447 INFO:tasks.workunit.client.0.smithi134.stderr:++ seq -w 00 99 2023-12-06T04:22:59.448 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:59.448 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.00 2023-12-06T04:22:59.564 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:59.566 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:59.566 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.01 2023-12-06T04:22:59.646 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:59.649 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:59.649 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.02 2023-12-06T04:22:59.755 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:59.758 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:59.758 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.03 2023-12-06T04:22:59.853 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:59.856 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:59.856 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.04 2023-12-06T04:22:59.945 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:22:59.947 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:22:59.947 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.05 2023-12-06T04:23:00.053 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.055 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.056 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.06 2023-12-06T04:23:00.141 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.144 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.144 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.07 2023-12-06T04:23:00.233 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:00.232+0000 7fdf445f1700 0 -- 172.21.15.134:0/351223780 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fdf240363a0 msgr2=0x7fdf240387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:00.237 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.240 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.240 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.08 2023-12-06T04:23:00.343 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:00.342+0000 7f9fb5ab8700 0 -- 172.21.15.134:0/3992062132 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f9f9c014c90 msgr2=0x7f9f9c011e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:00.343 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.345 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.346 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.09 2023-12-06T04:23:00.440 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.443 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.443 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.10 2023-12-06T04:23:00.546 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.548 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.548 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.11 2023-12-06T04:23:00.665 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.668 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.668 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.12 2023-12-06T04:23:00.762 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.764 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.764 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.13 2023-12-06T04:23:00.860 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.862 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.863 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.14 2023-12-06T04:23:00.975 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:00.977 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:00.978 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.15 2023-12-06T04:23:01.076 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:01.078 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:01.079 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.16 2023-12-06T04:23:01.172 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:01.175 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:01.175 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.17 2023-12-06T04:23:01.265 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:01.267 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:01.267 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.18 2023-12-06T04:23:01.382 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:01.382+0000 7f37cd69a700 0 -- 172.21.15.134:0/2451848772 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55edaa0044e0 msgr2=0x55edaa001b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:01.383 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:01.385 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:01.385 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.19 2023-12-06T04:23:01.490 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:01.490+0000 7ff9a6327700 0 -- 172.21.15.134:0/2115199863 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7ff9880363a0 msgr2=0x7ff9880387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:23:01.497 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:01.500 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:01.501 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.20 2023-12-06T04:23:01.593 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:01.596 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:01.596 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.21 2023-12-06T04:23:01.702 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:01.704 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:01.705 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.22 2023-12-06T04:23:01.811 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:01.814 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:01.814 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.23 2023-12-06T04:23:01.911 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:01.910+0000 7f3c4ccc0700 0 -- 172.21.15.134:0/3547113764 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f3c2c0363a0 msgr2=0x7f3c2c0387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:23:01.912 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:01.915 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:01.915 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.24 2023-12-06T04:23:02.016 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:02.018 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:02.018 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.25 2023-12-06T04:23:02.189 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:02.191 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:02.191 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.26 2023-12-06T04:23:02.309 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:02.308+0000 7fc3fd8db700 0 -- 172.21.15.134:0/237134843 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x5650efece370 msgr2=0x5650eff11cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:02.309 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:02.311 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:02.311 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.27 2023-12-06T04:23:02.406 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:02.409 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:02.409 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.28 2023-12-06T04:23:02.512 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:02.515 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:02.515 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.29 2023-12-06T04:23:02.631 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:02.631+0000 7fb07cbc8700 0 -- 172.21.15.134:0/4236325001 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fb0600363a0 msgr2=0x7fb0600387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:02.633 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:02.636 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:02.636 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.30 2023-12-06T04:23:02.744 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:02.747 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:02.747 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.31 2023-12-06T04:23:02.853 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:02.855 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:02.855 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.32 2023-12-06T04:23:02.954 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:02.956 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:02.956 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.33 2023-12-06T04:23:03.058 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:03.060 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:03.060 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.34 2023-12-06T04:23:03.173 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:03.176 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:03.176 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.35 2023-12-06T04:23:03.274 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:03.276 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:03.276 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.36 2023-12-06T04:23:03.364 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:03.367 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:03.367 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.37 2023-12-06T04:23:03.497 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:03.500 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:03.500 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.38 2023-12-06T04:23:03.586 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:03.586+0000 7ff02c8c9700 0 -- 172.21.15.134:0/4268228535 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7ff00c0363a0 msgr2=0x7ff00c0387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:03.588 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:03.591 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:03.591 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.39 2023-12-06T04:23:03.682 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:03.684 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:03.684 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.40 2023-12-06T04:23:03.806 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:03.806+0000 7fc7c1a9b700 0 -- 172.21.15.134:0/1142022140 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fc79c001550 msgr2=0x7fc79c008c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:03.806 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:03.809 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:03.809 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.41 2023-12-06T04:23:03.898 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:03.900 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:03.900 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.42 2023-12-06T04:23:04.012 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.015 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.015 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.43 2023-12-06T04:23:04.124 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.126 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.126 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.44 2023-12-06T04:23:04.217 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:04.216+0000 7f217f942700 0 -- 172.21.15.134:0/3319306579 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f215c008780 msgr2=0x7f215c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:04.220 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.222 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.222 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.45 2023-12-06T04:23:04.334 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.336 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.337 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.46 2023-12-06T04:23:04.448 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.451 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.451 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.47 2023-12-06T04:23:04.537 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.540 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.540 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.48 2023-12-06T04:23:04.644 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.646 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.647 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.49 2023-12-06T04:23:04.742 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.745 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.745 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.50 2023-12-06T04:23:04.846 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:04.844+0000 7f603107e700 0 -- 172.21.15.134:0/2878365462 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f6010036350 msgr2=0x7f6010038780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:23:04.853 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.855 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.855 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.51 2023-12-06T04:23:04.946 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:04.948 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:04.948 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.52 2023-12-06T04:23:05.057 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.060 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.060 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.53 2023-12-06T04:23:05.147 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.149 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.149 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.54 2023-12-06T04:23:05.242 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.245 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.245 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.55 2023-12-06T04:23:05.359 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.361 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.361 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.56 2023-12-06T04:23:05.449 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.451 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.451 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.57 2023-12-06T04:23:05.540 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.542 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.543 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.58 2023-12-06T04:23:05.634 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.638 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.638 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.59 2023-12-06T04:23:05.737 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.739 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.739 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.60 2023-12-06T04:23:05.835 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.837 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.837 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.61 2023-12-06T04:23:05.939 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:05.942 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:05.942 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.62 2023-12-06T04:23:06.049 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:06.049 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:06.050 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.63 2023-12-06T04:23:06.145 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:06.147 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:06.147 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.64 2023-12-06T04:23:06.251 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:06.254 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:06.254 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.65 2023-12-06T04:23:06.357 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:06.360 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:06.360 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.66 2023-12-06T04:23:06.447 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:06.445+0000 7f801c25b700 0 -- 172.21.15.134:0/3387837604 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f7ffc036390 msgr2=0x7f7ffc0387c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:06.450 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:06.453 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:06.453 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.67 2023-12-06T04:23:06.613 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:06.616 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:06.616 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.68 2023-12-06T04:23:06.717 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:06.720 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:06.720 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.69 2023-12-06T04:23:06.818 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:06.817+0000 7f96d9b0a700 0 -- 172.21.15.134:0/1928792204 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f96bc0363a0 msgr2=0x7f96bc0387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:06.822 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:06.825 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:06.825 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.70 2023-12-06T04:23:06.939 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:06.941 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:06.941 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.71 2023-12-06T04:23:07.038 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.041 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.041 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.72 2023-12-06T04:23:07.143 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.146 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.146 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.73 2023-12-06T04:23:07.249 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.251 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.251 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.74 2023-12-06T04:23:07.352 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.355 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.355 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.75 2023-12-06T04:23:07.450 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:07.449+0000 7f6753f4a700 0 -- 172.21.15.134:0/1458244039 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f67340362d0 msgr2=0x7f6734038700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:23:07.454 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.456 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.456 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.76 2023-12-06T04:23:07.556 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:07.554+0000 7f00042e9700 0 -- 172.21.15.134:0/3908710913 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7effe0008780 msgr2=0x7effe000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:07.556 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.558 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.558 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.77 2023-12-06T04:23:07.657 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:07.655+0000 7fb785287700 0 -- 172.21.15.134:0/3532771774 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fb7680363a0 msgr2=0x7fb7680387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:07.658 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.661 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.661 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.78 2023-12-06T04:23:07.768 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.771 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.771 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.79 2023-12-06T04:23:07.868 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.870 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.870 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.80 2023-12-06T04:23:07.962 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:07.964 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:07.964 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.81 2023-12-06T04:23:08.073 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:08.075 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:08.076 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.82 2023-12-06T04:23:08.170 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:08.173 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:08.173 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.83 2023-12-06T04:23:08.278 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:08.280 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:08.281 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.84 2023-12-06T04:23:08.376 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:08.378 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:08.379 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.85 2023-12-06T04:23:08.475 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:08.474+0000 7f196f92a700 0 -- 172.21.15.134:0/3759974708 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f19500362d0 msgr2=0x7f1950038700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:08.478 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:08.480 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:08.480 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.86 2023-12-06T04:23:08.583 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:08.586 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:08.586 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.87 2023-12-06T04:23:08.685 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:08.688 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:08.688 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.88 2023-12-06T04:23:08.791 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:08.794 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:08.794 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.89 2023-12-06T04:23:08.896 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:08.899 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:08.899 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.90 2023-12-06T04:23:09.059 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:09.061 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:09.061 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.91 2023-12-06T04:23:09.155 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:09.158 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:09.158 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.92 2023-12-06T04:23:09.300 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:09.303 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:09.303 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.93 2023-12-06T04:23:09.403 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:09.405 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:09.405 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.94 2023-12-06T04:23:09.507 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:09.510 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:09.510 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.95 2023-12-06T04:23:09.610 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:09.613 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:09.613 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.96 2023-12-06T04:23:09.708 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:09.707+0000 7fecd25ef700 0 -- 172.21.15.134:0/94747789 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fecb40363a0 msgr2=0x7fecb40387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:23:09.713 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:09.716 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:09.716 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.97 2023-12-06T04:23:09.816 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:09.814+0000 7f3fdee55700 0 -- 172.21.15.134:0/3631150875 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f3fc00363a0 msgr2=0x7f3fc00387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:23:09.821 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:09.824 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:09.824 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.98 2023-12-06T04:23:09.912 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:09.910+0000 7f55461e2700 0 -- 172.21.15.134:0/1180337361 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f552c008780 msgr2=0x7f552c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:09.912 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:09.914 INFO:tasks.workunit.client.0.smithi134.stderr:+ for i in $(seq -w 00 99) 2023-12-06T04:23:09.914 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm image.99 2023-12-06T04:23:10.019 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:10.022 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_remove 2023-12-06T04:23:10.022 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing remove...' 2023-12-06T04:23:10.023 INFO:tasks.workunit.client.0.smithi134.stdout:testing remove... 2023-12-06T04:23:10.023 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:23:10.023 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.098 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.169 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.242 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.314 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.387 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.466 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.540 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.612 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.688 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.760 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.831 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.905 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:10.976 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:11.052 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:11.124 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:11.196 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:11.267 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:11.338 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd remove NOT_EXIST 2023-12-06T04:23:11.377 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 0% complete...failed. 2023-12-06T04:23:11.378 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: delete error: (2) No such file or directory 2023-12-06T04:23:11.381 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:23:11.381 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 1 -s 1 test1 2023-12-06T04:23:11.402 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:23:11.407 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:11.406+0000 7f3d60e56380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:11.414 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:23:11.455 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:11.458 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:23:11.458 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:23:11.458 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:23:11.483 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:23:11.484 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test2 2023-12-06T04:23:11.536 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:11.643 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:11.647 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:23:11.647 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:23:11.647 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:23:11.674 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:23:11.674 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 1 -s 1 test1 2023-12-06T04:23:11.696 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:23:11.701 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:11.700+0000 7f5406fa7380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:11.708 INFO:tasks.workunit.client.0.smithi134.stderr:+ rados rm -p rbd test1.rbd 2023-12-06T04:23:11.736 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:23:11.765 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:11.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:23:11.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:23:11.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:23:11.793 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:23:11.794 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 1 -eq 0 ']' 2023-12-06T04:23:11.794 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test2 2023-12-06T04:23:11.835 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test2@snap 2023-12-06T04:23:12.544 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:23:12.555 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap protect test2@snap 2023-12-06T04:23:12.598 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone test2@snap clone --rbd-default-clone-format 1 2023-12-06T04:23:12.663 INFO:tasks.workunit.client.0.smithi134.stderr:+ rados -p rbd rm rbd_children 2023-12-06T04:23:12.691 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm clone 2023-12-06T04:23:12.789 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:12.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:23:12.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep clone 2023-12-06T04:23:12.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:23:12.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:23:12.818 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:23:12.818 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap unprotect test2@snap 2023-12-06T04:23:12.857 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm test2@snap 2023-12-06T04:23:13.544 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:23:13.556 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:13.651 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:13.654 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_migration 2023-12-06T04:23:13.654 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing migration...' 2023-12-06T04:23:13.655 INFO:tasks.workunit.client.0.smithi134.stdout:testing migration... 2023-12-06T04:23:13.655 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:23:13.655 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:13.728 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:13.804 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:13.880 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:13.955 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.032 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.104 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.175 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.248 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.323 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.395 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.496 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.572 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.647 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.719 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.790 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.862 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:14.935 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:15.011 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd pool create rbd2 8 2023-12-06T04:23:15.654 INFO:tasks.workunit.client.0.smithi134.stderr:pool 'rbd2' already exists 2023-12-06T04:23:15.663 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd pool init rbd2 2023-12-06T04:23:18.543 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 1 -s 128M test1 2023-12-06T04:23:18.567 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:23:18.574 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:18.572+0000 7f4cfe02f380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:18.581 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info test1 2023-12-06T04:23:18.581 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'format: 1' 2023-12-06T04:23:18.613 INFO:tasks.workunit.client.0.smithi134.stdout: format: 1 2023-12-06T04:23:18.614 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test1 --image-format 2 2023-12-06T04:23:18.689 INFO:tasks.workunit.client.0.smithi134.stderr:++ get_migration_state test1 2023-12-06T04:23:18.689 INFO:tasks.workunit.client.0.smithi134.stderr:++ local image=test1 2023-12-06T04:23:18.689 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd --format xml status test1 2023-12-06T04:23:18.689 INFO:tasks.workunit.client.0.smithi134.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T04:23:18.767 INFO:tasks.workunit.client.0.smithi134.stderr:+ test prepared = prepared 2023-12-06T04:23:18.767 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info test1 2023-12-06T04:23:18.767 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'format: 2' 2023-12-06T04:23:18.802 INFO:tasks.workunit.client.0.smithi134.stdout: format: 2 2023-12-06T04:23:18.803 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:23:18.836 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:18.835+0000 7f22acca5380 -1 librbd::image::PreRemoveRequest: 0x55c2e43c4090 validate_image_removal: image in migration state - not removing 2023-12-06T04:23:18.839 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 0% complete...failed. 2023-12-06T04:23:18.839 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: error: image still has watchers 2023-12-06T04:23:18.839 INFO:tasks.workunit.client.0.smithi134.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-12-06T04:23:18.841 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:23:18.841 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute test1 2023-12-06T04:23:18.946 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T04:23:18.944+0000 7fb08877b700 0 -- 172.21.15.134:0/734305202 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fb064008780 msgr2=0x7fb06400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:18.971 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:18.970+0000 7fb08877b700 0 -- 172.21.15.134:0/734305202 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fb06c036b60 msgr2=0x7fb06c038f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:23:18.985 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:18.989 INFO:tasks.workunit.client.0.smithi134.stderr:++ get_migration_state test1 2023-12-06T04:23:18.989 INFO:tasks.workunit.client.0.smithi134.stderr:++ local image=test1 2023-12-06T04:23:18.989 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd --format xml status test1 2023-12-06T04:23:18.989 INFO:tasks.workunit.client.0.smithi134.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T04:23:19.049 INFO:tasks.workunit.client.0.smithi134.stderr:+ test executed = executed 2023-12-06T04:23:19.050 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit test1 2023-12-06T04:23:19.134 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete...2023-12-06T04:23:19.133+0000 7f4e1b23c700 0 -- 172.21.15.134:0/3387949437 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f4e00036b60 msgr2=0x7f4e00038f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:19.342 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-12-06T04:23:19.340+0000 7f4e1b23c700 0 -- 172.21.15.134:0/3387949437 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f4e00036b60 msgr2=0x7f4e00038f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:19.351 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 100% complete...done. 2023-12-06T04:23:19.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ get_migration_state test1 2023-12-06T04:23:19.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ local image=test1 2023-12-06T04:23:19.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --format xml status test1 2023-12-06T04:23:19.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ xmlstarlet sel -t -v //status/migration/state 2023-12-06T04:23:19.388 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:23:19.388 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info test1 2023-12-06T04:23:19.388 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'features: .*layering' 2023-12-06T04:23:19.420 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:23:19.420 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test1 --image-feature layering,exclusive-lock,object-map,fast-diff,deep-flatten 2023-12-06T04:23:19.527 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info test1 2023-12-06T04:23:19.527 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'features: .*layering' 2023-12-06T04:23:19.565 INFO:tasks.workunit.client.0.smithi134.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, migrating 2023-12-06T04:23:19.566 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute test1 2023-12-06T04:23:19.649 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T04:23:19.647+0000 7f8d10513700 0 -- 172.21.15.134:0/2125413760 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f8cec008780 msgr2=0x7f8cec00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:19.675 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:19.674+0000 7f8d10513700 0 -- 172.21.15.134:0/2125413760 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f8cf4036b60 msgr2=0x7f8cf4038f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:19.676 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:19.678 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit test1 2023-12-06T04:23:19.759 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:19.758+0000 7f150b69c700 0 -- 172.21.15.134:0/2840675878 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f14e8008780 msgr2=0x7f14e800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:19.770 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete...2023-12-06T04:23:19.767+0000 7f150be9d700 0 -- 172.21.15.134:0/2840675878 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x555b8a4d5a20 msgr2=0x555b8a52ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:19.790 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-12-06T04:23:19.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test1 rbd2/test1 2023-12-06T04:23:19.893 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:19.891+0000 7f0168995700 0 -- 172.21.15.134:0/1144658430 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f0144008780 msgr2=0x7f014400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:19.896 INFO:tasks.workunit.client.0.smithi134.stderr:++ get_migration_state rbd2/test1 2023-12-06T04:23:19.896 INFO:tasks.workunit.client.0.smithi134.stderr:++ local image=rbd2/test1 2023-12-06T04:23:19.897 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd --format xml status rbd2/test1 2023-12-06T04:23:19.897 INFO:tasks.workunit.client.0.smithi134.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T04:23:19.970 INFO:tasks.workunit.client.0.smithi134.stderr:+ test prepared = prepared 2023-12-06T04:23:19.971 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:23:19.971 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:23:19.971 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:23:19.995 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:23:19.996 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd -p rbd2 ls 2023-12-06T04:23:19.996 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:23:20.022 INFO:tasks.workunit.client.0.smithi134.stdout:test1 2023-12-06T04:23:20.023 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute test1 2023-12-06T04:23:20.125 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T04:23:20.124+0000 7f9161eea700 0 -- 172.21.15.134:0/2573813276 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55b75516b560 msgr2=0x55b755258d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:20.128 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:20.131 INFO:tasks.workunit.client.0.smithi134.stderr:++ get_migration_state rbd2/test1 2023-12-06T04:23:20.131 INFO:tasks.workunit.client.0.smithi134.stderr:++ local image=rbd2/test1 2023-12-06T04:23:20.131 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd --format xml status rbd2/test1 2023-12-06T04:23:20.132 INFO:tasks.workunit.client.0.smithi134.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T04:23:20.191 INFO:tasks.workunit.client.0.smithi134.stderr:+ test executed = executed 2023-12-06T04:23:20.191 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm rbd2/test1 2023-12-06T04:23:20.228 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:20.227+0000 7f64faffd700 -1 librbd::image::PreRemoveRequest: 0x558bbec21ca0 validate_image_removal: image in migration state - not removing 2023-12-06T04:23:20.233 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 0% complete...failed. 2023-12-06T04:23:20.233 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: error: image still has watchers 2023-12-06T04:23:20.233 INFO:tasks.workunit.client.0.smithi134.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-12-06T04:23:20.235 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:23:20.235 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit test1 2023-12-06T04:23:20.316 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-12-06T04:23:20.314+0000 7fd7bc9d0700 0 -- 172.21.15.134:0/3709313443 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55945b823060 msgr2=0x55945b87ef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:20.324 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 100% complete...done. 2023-12-06T04:23:20.327 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd namespace create rbd2/ns1 2023-12-06T04:23:20.357 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd namespace create rbd2/ns2 2023-12-06T04:23:20.586 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare rbd2/test1 rbd2/ns1/test1 2023-12-06T04:23:20.676 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:20.675+0000 7fd65ae66700 0 -- 172.21.15.134:0/1131118841 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fd63c004bc0 msgr2=0x7fd63c006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:20.682 INFO:tasks.workunit.client.0.smithi134.stderr:++ get_migration_state rbd2/ns1/test1 2023-12-06T04:23:20.682 INFO:tasks.workunit.client.0.smithi134.stderr:++ local image=rbd2/ns1/test1 2023-12-06T04:23:20.682 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-12-06T04:23:20.682 INFO:tasks.workunit.client.0.smithi134.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T04:23:20.754 INFO:tasks.workunit.client.0.smithi134.stderr:+ test prepared = prepared 2023-12-06T04:23:20.754 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute rbd2/test1 2023-12-06T04:23:20.823 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T04:23:20.822+0000 7f21d7d72700 0 -- 172.21.15.134:0/1556133973 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x564cd0a35fa0 msgr2=0x564cd0a38390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:20.825 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:20.828 INFO:tasks.workunit.client.0.smithi134.stderr:++ get_migration_state rbd2/ns1/test1 2023-12-06T04:23:20.828 INFO:tasks.workunit.client.0.smithi134.stderr:++ local image=rbd2/ns1/test1 2023-12-06T04:23:20.828 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-12-06T04:23:20.828 INFO:tasks.workunit.client.0.smithi134.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-12-06T04:23:20.886 INFO:tasks.workunit.client.0.smithi134.stderr:+ test executed = executed 2023-12-06T04:23:20.886 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit rbd2/test1 2023-12-06T04:23:20.957 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-12-06T04:23:20.956+0000 7fc8bea9a700 0 -- 172.21.15.134:0/1011943157 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fc8a0036b60 msgr2=0x7fc8a0038f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:20.976 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 100% complete...done. 2023-12-06T04:23:20.979 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare rbd2/ns1/test1 rbd2/ns2/test1 2023-12-06T04:23:21.070 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:21.068+0000 7f8aa1036700 0 -- 172.21.15.134:0/2119443887 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x560d6dca0d60 msgr2=0x560d6dca3150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:21.074 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute rbd2/ns2/test1 2023-12-06T04:23:21.139 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T04:23:21.138+0000 7f07a7dc3700 0 -- 172.21.15.134:0/1083457578 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x55d3caf18780 msgr2=0x55d3cafbe1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:21.152 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:21.155 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit rbd2/ns2/test1 2023-12-06T04:23:21.230 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:21.229+0000 7fce65890700 0 -- 172.21.15.134:0/3770780118 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x55b146dc6fc0 msgr2=0x55b146e6c7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:21.247 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-12-06T04:23:21.244+0000 7fce65890700 0 -- 172.21.15.134:0/3770780118 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fce48036b60 msgr2=0x7fce48038f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:21.268 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 100% complete...done. 2023-12-06T04:23:21.271 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M test1 2023-12-06T04:23:21.297 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:21.295+0000 7fdd59b8d380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:21.303 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test1 --data-pool rbd2 2023-12-06T04:23:21.376 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info test1 2023-12-06T04:23:21.376 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'data_pool: rbd2' 2023-12-06T04:23:21.411 INFO:tasks.workunit.client.0.smithi134.stdout: data_pool: rbd2 2023-12-06T04:23:21.411 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute test1 2023-12-06T04:23:21.488 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T04:23:21.486+0000 7f7653d38700 0 -- 172.21.15.134:0/2216796908 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x558484af3560 msgr2=0x558484bdfb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:21.507 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:21.505+0000 7f7653d38700 0 -- 172.21.15.134:0/2216796908 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f7634036b60 msgr2=0x7f7634038f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:21.512 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:21.515 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit test1 2023-12-06T04:23:21.737 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:21.736+0000 7fe9b7b20700 0 --2- 172.21.15.134:0/1359693851 >> v2:172.21.15.134:3300/0 conn(0x561fd7f7c6f0 0x561fd7f7cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-06T04:23:21.799 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete...2023-12-06T04:23:21.798+0000 7fe9b7b20700 0 -- 172.21.15.134:0/176573082 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fe998004bc0 msgr2=0x7fe998006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:21.814 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... 2023-12-06T04:23:21.813+0000 7fe9b8321700 0 -- 172.21.15.134:0/176573082 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fe9a0001d90 msgr2=0x561fd8069880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:21.830 INFO:tasks.workunit.client.0.smithi134.stderr:Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-12-06T04:23:21.832 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test1 2023-12-06T04:23:21.914 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd trash mv test1 2023-12-06T04:23:21.914 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv test1 2023-12-06T04:23:21.948 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:21.946+0000 7f1102b13380 -1 librbd::api::Trash: move: cannot move migrating image to trash 2023-12-06T04:23:21.949 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: deferred delete error: (16) Device or resource busy 2023-12-06T04:23:21.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:21.952 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd trash ls -a 2023-12-06T04:23:21.952 INFO:tasks.workunit.client.0.smithi134.stderr:++ cut -d ' ' -f 1 2023-12-06T04:23:21.979 INFO:tasks.workunit.client.0.smithi134.stderr:+ ID=19db2eedc4d0 2023-12-06T04:23:21.980 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd trash rm 19db2eedc4d0 2023-12-06T04:23:21.980 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash rm 19db2eedc4d0 2023-12-06T04:23:22.011 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:22.009+0000 7fafd77fe700 -1 librbd::image::RefreshRequest: image being migrated 2023-12-06T04:23:22.011 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:22.009+0000 7fafd77fe700 -1 librbd::image::OpenRequest: failed to refresh image: (30) Read-only file system 2023-12-06T04:23:22.011 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:22.009+0000 7fafd77fe700 -1 librbd::ImageState: 0x7fafb4048b60 failed to open image: (30) Read-only file system 2023-12-06T04:23:22.011 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:22.009+0000 7fafd184f700 -1 librbd::image::RemoveRequest: 0x7fafb4000b80 handle_open_image: error opening image: (30) Read-only file system 2023-12-06T04:23:22.013 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: remove error: (30) Read-only file system 2023-12-06T04:23:22.013 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 0% complete...failed. 2023-12-06T04:23:22.015 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:22.015 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd trash restore 19db2eedc4d0 2023-12-06T04:23:22.015 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash restore 19db2eedc4d0 2023-12-06T04:23:22.040 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: restore error: (22) Invalid argument 2023-12-06T04:23:22.040 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:22.038+0000 7faa4966c380 -1 librbd::api::Trash: restore: Current trash source 'migration' does not match expected: user,mirroring,unknown (4) 2023-12-06T04:23:22.042 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:22.042 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort test1 2023-12-06T04:23:22.140 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T04:23:22.139+0000 7f7e4a72c700 0 -- 172.21.15.134:0/4038452803 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f7e30008780 msgr2=0x7f7e3000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:22.170 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:22.169+0000 7f7e4af2d700 0 -- 172.21.15.134:0/4038452803 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x5626e863b560 msgr2=0x5626e8728a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:22.180 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 100% complete...done. 2023-12-06T04:23:22.182 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd remove test1 2023-12-06T04:23:22.284 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T04:23:22.287 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/dev/urandom bs=1M count=1 2023-12-06T04:23:22.287 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd --image-format 2 import - test1 2023-12-06T04:23:22.334 INFO:tasks.workunit.client.0.smithi134.stderr:1+0 records in 2023-12-06T04:23:22.334 INFO:tasks.workunit.client.0.smithi134.stderr:1+0 records out 2023-12-06T04:23:22.334 INFO:tasks.workunit.client.0.smithi134.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0461945 s, 22.7 MB/s 2023-12-06T04:23:22.368 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 100% complete...done. 2023-12-06T04:23:22.371 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd export test1 - 2023-12-06T04:23:22.371 INFO:tasks.workunit.client.0.smithi134.stderr:++ md5sum 2023-12-06T04:23:22.404 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 100% complete...done. 2023-12-06T04:23:22.407 INFO:tasks.workunit.client.0.smithi134.stderr:+ md5sum='e5c24946f512ba470a9b29b020537f42 -' 2023-12-06T04:23:22.407 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@snap1 2023-12-06T04:23:22.555 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:23:22.562 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap protect test1@snap1 2023-12-06T04:23:22.600 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@snap2 2023-12-06T04:23:23.560 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:23:23.568 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone test1@snap1 clone_v1 --rbd_default_clone_format=1 2023-12-06T04:23:23.641 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone test1@snap2 clone_v2 --rbd_default_clone_format=2 2023-12-06T04:23:23.716 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info clone_v1 2023-12-06T04:23:23.716 INFO:tasks.workunit.client.0.smithi134.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-12-06T04:23:23.754 INFO:tasks.workunit.client.0.smithi134.stdout: parent: rbd/test1@snap1 2023-12-06T04:23:23.755 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info clone_v2 2023-12-06T04:23:23.755 INFO:tasks.workunit.client.0.smithi134.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-12-06T04:23:23.794 INFO:tasks.workunit.client.0.smithi134.stdout: parent: rbd/test1@snap2 2023-12-06T04:23:23.795 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info clone_v2 2023-12-06T04:23:23.795 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'op_features: clone-child' 2023-12-06T04:23:23.834 INFO:tasks.workunit.client.0.smithi134.stdout: op_features: clone-child 2023-12-06T04:23:23.834 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd export clone_v1 - 2023-12-06T04:23:23.834 INFO:tasks.workunit.client.0.smithi134.stderr:++ md5sum 2023-12-06T04:23:23.874 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 100% complete...done. 2023-12-06T04:23:23.878 INFO:tasks.workunit.client.0.smithi134.stderr:+ test 'e5c24946f512ba470a9b29b020537f42 -' = 'e5c24946f512ba470a9b29b020537f42 -' 2023-12-06T04:23:23.878 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd export clone_v2 - 2023-12-06T04:23:23.878 INFO:tasks.workunit.client.0.smithi134.stderr:++ md5sum 2023-12-06T04:23:23.918 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 100% complete...done. 2023-12-06T04:23:23.921 INFO:tasks.workunit.client.0.smithi134.stderr:+ test 'e5c24946f512ba470a9b29b020537f42 -' = 'e5c24946f512ba470a9b29b020537f42 -' 2023-12-06T04:23:23.921 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd children test1@snap1 2023-12-06T04:23:23.961 INFO:tasks.workunit.client.0.smithi134.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-12-06T04:23:23.961 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd children test1@snap2 2023-12-06T04:23:23.995 INFO:tasks.workunit.client.0.smithi134.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-12-06T04:23:23.995 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test1 rbd2/test2 2023-12-06T04:23:24.082 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:24.081+0000 7feaa74bf700 0 -- 172.21.15.134:0/1155519355 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55e5256b42f0 msgr2=0x55e52579ccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:25.555 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:25.554+0000 7feaa74bf700 0 -- 172.21.15.134:0/1155519355 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fea8c036a50 msgr2=0x7fea8c038e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:25.635 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info clone_v1 2023-12-06T04:23:25.635 INFO:tasks.workunit.client.0.smithi134.stderr:+ fgrep 'parent: rbd2/test2@snap1' 2023-12-06T04:23:25.687 INFO:tasks.workunit.client.0.smithi134.stdout: parent: rbd2/test2@snap1 2023-12-06T04:23:25.687 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info clone_v2 2023-12-06T04:23:25.687 INFO:tasks.workunit.client.0.smithi134.stderr:+ fgrep 'parent: rbd2/test2@snap2' 2023-12-06T04:23:25.739 INFO:tasks.workunit.client.0.smithi134.stdout: parent: rbd2/test2@snap2 2023-12-06T04:23:25.739 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info clone_v2 2023-12-06T04:23:25.739 INFO:tasks.workunit.client.0.smithi134.stderr:+ fgrep 'op_features: clone-child' 2023-12-06T04:23:25.790 INFO:tasks.workunit.client.0.smithi134.stdout: op_features: clone-child 2023-12-06T04:23:25.790 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd children rbd2/test2@snap1 2023-12-06T04:23:25.842 INFO:tasks.workunit.client.0.smithi134.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-12-06T04:23:25.842 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd children rbd2/test2@snap2 2023-12-06T04:23:25.888 INFO:tasks.workunit.client.0.smithi134.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-12-06T04:23:25.889 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute test1 2023-12-06T04:23:25.971 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:25.973 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd migration commit test1 2023-12-06T04:23:25.973 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit test1 2023-12-06T04:23:26.036 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: the image has descendants: 2023-12-06T04:23:26.036 INFO:tasks.workunit.client.0.smithi134.stderr: rbd/clone_v1 2023-12-06T04:23:26.036 INFO:tasks.workunit.client.0.smithi134.stderr: rbd/clone_v2 2023-12-06T04:23:26.036 INFO:tasks.workunit.client.0.smithi134.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-12-06T04:23:26.036 INFO:tasks.workunit.client.0.smithi134.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-12-06T04:23:26.038 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:26.039 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit test1 --force 2023-12-06T04:23:26.103 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: the image has descendants: 2023-12-06T04:23:26.103 INFO:tasks.workunit.client.0.smithi134.stderr: rbd/clone_v1 2023-12-06T04:23:26.103 INFO:tasks.workunit.client.0.smithi134.stderr: rbd/clone_v2 2023-12-06T04:23:26.103 INFO:tasks.workunit.client.0.smithi134.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-12-06T04:23:26.103 INFO:tasks.workunit.client.0.smithi134.stderr:Proceeding anyway due to force flag set. 2023-12-06T04:23:26.116 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:26.115+0000 7f2cedf16700 0 -- 172.21.15.134:0/2428380738 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55e80e875ab0 msgr2=0x55e80e8cf020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:26.127 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:26.126+0000 7f2cedf16700 0 -- 172.21.15.134:0/2428380738 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f2cd0036a60 msgr2=0x7f2cd0038e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:27.573 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 100% complete...done. 2023-12-06T04:23:27.577 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd export clone_v1 - 2023-12-06T04:23:27.577 INFO:tasks.workunit.client.0.smithi134.stderr:++ md5sum 2023-12-06T04:23:27.621 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 100% complete...done. 2023-12-06T04:23:27.625 INFO:tasks.workunit.client.0.smithi134.stderr:+ test 'e5c24946f512ba470a9b29b020537f42 -' = 'e5c24946f512ba470a9b29b020537f42 -' 2023-12-06T04:23:27.625 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd export clone_v2 - 2023-12-06T04:23:27.625 INFO:tasks.workunit.client.0.smithi134.stderr:++ md5sum 2023-12-06T04:23:27.667 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 100% complete...done. 2023-12-06T04:23:27.670 INFO:tasks.workunit.client.0.smithi134.stderr:+ test 'e5c24946f512ba470a9b29b020537f42 -' = 'e5c24946f512ba470a9b29b020537f42 -' 2023-12-06T04:23:27.670 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare rbd2/test2 test1 2023-12-06T04:23:27.755 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:27.754+0000 7f4a678e4700 0 -- 172.21.15.134:0/11344059 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55a76c8ddff0 msgr2=0x55a76c938c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:29.572 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:29.570+0000 7f4a678e4700 0 -- 172.21.15.134:0/11344059 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f4a4c036b90 msgr2=0x7f4a4c038fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:29.657 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info clone_v1 2023-12-06T04:23:29.657 INFO:tasks.workunit.client.0.smithi134.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-12-06T04:23:29.712 INFO:tasks.workunit.client.0.smithi134.stdout: parent: rbd/test1@snap1 2023-12-06T04:23:29.713 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info clone_v2 2023-12-06T04:23:29.713 INFO:tasks.workunit.client.0.smithi134.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-12-06T04:23:29.768 INFO:tasks.workunit.client.0.smithi134.stdout: parent: rbd/test1@snap2 2023-12-06T04:23:29.769 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info clone_v2 2023-12-06T04:23:29.769 INFO:tasks.workunit.client.0.smithi134.stderr:+ fgrep 'op_features: clone-child' 2023-12-06T04:23:29.821 INFO:tasks.workunit.client.0.smithi134.stdout: op_features: clone-child 2023-12-06T04:23:29.821 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd children test1@snap1 2023-12-06T04:23:29.873 INFO:tasks.workunit.client.0.smithi134.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-12-06T04:23:29.873 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd children test1@snap2 2023-12-06T04:23:29.920 INFO:tasks.workunit.client.0.smithi134.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-12-06T04:23:29.920 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute test1 2023-12-06T04:23:30.038 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:30.041 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd migration commit test1 2023-12-06T04:23:30.041 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit test1 2023-12-06T04:23:30.113 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: the image has descendants: 2023-12-06T04:23:30.113 INFO:tasks.workunit.client.0.smithi134.stderr: rbd/clone_v1 2023-12-06T04:23:30.113 INFO:tasks.workunit.client.0.smithi134.stderr: rbd/clone_v2 2023-12-06T04:23:30.113 INFO:tasks.workunit.client.0.smithi134.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-12-06T04:23:30.113 INFO:tasks.workunit.client.0.smithi134.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-12-06T04:23:30.115 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:30.115 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration commit test1 --force 2023-12-06T04:23:30.188 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: the image has descendants: 2023-12-06T04:23:30.188 INFO:tasks.workunit.client.0.smithi134.stderr: rbd/clone_v1 2023-12-06T04:23:30.188 INFO:tasks.workunit.client.0.smithi134.stderr: rbd/clone_v2 2023-12-06T04:23:30.189 INFO:tasks.workunit.client.0.smithi134.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-12-06T04:23:30.189 INFO:tasks.workunit.client.0.smithi134.stderr:Proceeding anyway due to force flag set. 2023-12-06T04:23:30.190 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:30.189+0000 7f71c5693700 0 -- 172.21.15.134:0/587598069 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f71a8036a10 msgr2=0x7f71a8038e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:30.200 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:30.199+0000 7f71c5693700 0 -- 172.21.15.134:0/587598069 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x5606551168f0 msgr2=0x7f71a8039460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:31.601 INFO:tasks.workunit.client.0.smithi134.stderr: Commit image migration: 100% complete...done. 2023-12-06T04:23:31.604 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd export clone_v1 - 2023-12-06T04:23:31.605 INFO:tasks.workunit.client.0.smithi134.stderr:++ md5sum 2023-12-06T04:23:31.647 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 100% complete...done. 2023-12-06T04:23:31.651 INFO:tasks.workunit.client.0.smithi134.stderr:+ test 'e5c24946f512ba470a9b29b020537f42 -' = 'e5c24946f512ba470a9b29b020537f42 -' 2023-12-06T04:23:31.652 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd export clone_v2 - 2023-12-06T04:23:31.652 INFO:tasks.workunit.client.0.smithi134.stderr:++ md5sum 2023-12-06T04:23:31.692 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 100% complete...done. 2023-12-06T04:23:31.695 INFO:tasks.workunit.client.0.smithi134.stderr:+ test 'e5c24946f512ba470a9b29b020537f42 -' = 'e5c24946f512ba470a9b29b020537f42 -' 2023-12-06T04:23:31.696 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd remove clone_v1 2023-12-06T04:23:31.813 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:31.811+0000 7fbd3e80b700 0 -- 172.21.15.134:0/3822540979 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55984ab6f570 msgr2=0x55984ab49ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:31.813 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:31.815 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd remove clone_v2 2023-12-06T04:23:31.916 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:31.914+0000 7fd83e01a700 0 -- 172.21.15.134:0/1452654484 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x55690c578cb0 msgr2=0x55690c61b350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:31.921 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:31.923 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap unprotect test1@snap1 2023-12-06T04:23:31.963 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap purge test1 2023-12-06T04:23:33.586 INFO:tasks.workunit.client.0.smithi134.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T04:23:33.595 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:23:33.715 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:33.713+0000 7f8aa7508700 0 -- 172.21.15.134:0/3748160013 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f8a84008780 msgr2=0x7f8a8400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:33.715 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:33.718 INFO:tasks.workunit.client.0.smithi134.stderr:+ for format in 1 2 2023-12-06T04:23:33.718 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T04:23:33.740 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:23:33.748 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:33.747+0000 7f5a8b4ce380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:33.755 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-12-06T04:23:33.836 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:33.876 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:33.881 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:33.881 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 200.005 bytes/sec: 200 KiB/s 2023-12-06T04:23:33.889 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort test2 2023-12-06T04:23:33.971 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T04:23:33.970+0000 7f4b6d068700 0 -- 172.21.15.134:0/4215635171 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x55e236895560 msgr2=0x55e236981b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:33.987 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 100% complete...done. 2023-12-06T04:23:33.990 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:34.024 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:34.029 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:34.029 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 200.005 bytes/sec: 200 KiB/s 2023-12-06T04:23:34.033 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:34.081 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T04:23:34.083 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T04:23:34.105 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:23:34.110 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:34.109+0000 7f98bf638380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:34.116 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-12-06T04:23:34.183 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:34.224 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:34.229 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:34.229 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 200.005 bytes/sec: 200 KiB/s 2023-12-06T04:23:34.234 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute test2 2023-12-06T04:23:34.331 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T04:23:34.329+0000 7fe22a17b700 0 -- 172.21.15.134:0/1702822195 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fe20c036bb0 msgr2=0x7fe20c038fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:34.356 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:34.355+0000 7fe22997a700 0 -- 172.21.15.134:0/1702822195 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fe210008780 msgr2=0x7fe21000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:34.369 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:34.372 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort test2 2023-12-06T04:23:34.444 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T04:23:34.443+0000 7f4401415700 0 -- 172.21.15.134:0/948256582 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f43dc008780 msgr2=0x7f43dc00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:34.456 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 100% complete...done. 2023-12-06T04:23:34.458 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:34.493 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:34.496 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:34.496 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-12-06T04:23:34.499 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:34.563 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T04:23:34.566 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T04:23:34.588 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:23:34.593 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:34.592+0000 7fee02919380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:34.599 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-12-06T04:23:34.640 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:34.638+0000 7fc8fc828380 -1 librbd::image::CreateRequest: 0x55d5b3bf9690 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-12-06T04:23:34.640 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:34.638+0000 7fc8fc828380 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-12-06T04:23:34.649 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-12-06T04:23:34.652 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:23:34.652 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:34.686 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:34.691 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:34.691 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-12-06T04:23:34.697 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:34.752 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T04:23:34.755 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T04:23:34.777 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:23:34.783 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:34.781+0000 7f60d2c46380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:34.789 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 rbd2/test2 2023-12-06T04:23:34.849 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-12-06T04:23:34.888 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:34.891 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:34.891 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-12-06T04:23:34.895 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort test2 2023-12-06T04:23:34.968 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-12-06T04:23:34.971 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:35.005 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:35.010 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:35.010 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 200.005 bytes/sec: 200 KiB/s 2023-12-06T04:23:35.015 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:35.074 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T04:23:35.077 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 1 test2 2023-12-06T04:23:35.099 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image format 1 is deprecated 2023-12-06T04:23:35.104 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:35.103+0000 7f4f3e429380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:35.113 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 rbd2/test2 2023-12-06T04:23:35.176 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort rbd2/test2 2023-12-06T04:23:35.241 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T04:23:35.240+0000 7fc1c03f7700 0 -- 172.21.15.134:0/2973226202 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7fc19c008780 msgr2=0x7fc19c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:35.249 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 100% complete...done. 2023-12-06T04:23:35.252 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:35.286 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:35.289 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:35.289 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-12-06T04:23:35.296 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:35.357 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T04:23:35.359 INFO:tasks.workunit.client.0.smithi134.stderr:+ test 1 = 1 2023-12-06T04:23:35.360 INFO:tasks.workunit.client.0.smithi134.stderr:+ continue 2023-12-06T04:23:35.360 INFO:tasks.workunit.client.0.smithi134.stderr:+ for format in 1 2 2023-12-06T04:23:35.360 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T04:23:35.404 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-12-06T04:23:35.523 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:35.570 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:35.574 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:35.574 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-12-06T04:23:35.582 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort test2 2023-12-06T04:23:35.693 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T04:23:35.692+0000 7f93cc296700 0 -- 172.21.15.134:0/1769339819 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f93a8008780 msgr2=0x7f93a800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:35.694 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 100% complete...done. 2023-12-06T04:23:35.697 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:35.740 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:35.742 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:35.742 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 500.011 bytes/sec: 500 KiB/s 2023-12-06T04:23:35.752 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:35.855 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T04:23:35.854+0000 7f5063dc3700 0 -- 172.21.15.134:0/2920595455 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f5044036bb0 msgr2=0x7f5044038fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:23:35.863 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:35.865 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T04:23:35.906 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-12-06T04:23:36.011 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:36.010+0000 7f1cd5f35700 0 -- 172.21.15.134:0/693176152 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x5648f8b011c0 msgr2=0x5648f8bef200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:36.014 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:36.061 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:36.072 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:36.072 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 90.9112 bytes/sec: 91 KiB/s 2023-12-06T04:23:36.085 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration execute test2 2023-12-06T04:23:36.180 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-12-06T04:23:36.179+0000 7f05cd203700 0 -- 172.21.15.134:0/3322558503 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x561c24116560 msgr2=0x561c24202b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:36.207 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:36.206+0000 7f05cd203700 0 -- 172.21.15.134:0/3322558503 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f05b0036c80 msgr2=0x7f05b00390b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:36.212 INFO:tasks.workunit.client.0.smithi134.stderr: Image migration: 100% complete...done. 2023-12-06T04:23:36.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort test2 2023-12-06T04:23:36.320 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-12-06T04:23:36.318+0000 7f81eb75e700 0 -- 172.21.15.134:0/2977787436 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x562eb4f42780 msgr2=0x562eb502eae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:36.320 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 100% complete...done. 2023-12-06T04:23:36.322 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:36.363 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:36.365 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:36.365 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 500.012 bytes/sec: 500 KiB/s 2023-12-06T04:23:36.373 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:36.487 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T04:23:36.486+0000 7f638ab05700 0 -- 172.21.15.134:0/858801657 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x5567ab84b720 msgr2=0x5567ab848d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:23:36.488 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:36.490 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T04:23:36.532 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-12-06T04:23:36.606 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:36.605+0000 7faba4fc1380 -1 librbd::image::CreateRequest: 0x557b97957690 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-12-06T04:23:36.606 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:36.605+0000 7faba4fc1380 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-12-06T04:23:36.628 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-12-06T04:23:36.630 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:23:36.630 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:36.670 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:36.674 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:36.674 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 333.341 bytes/sec: 333 KiB/s 2023-12-06T04:23:36.685 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:36.804 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T04:23:36.804+0000 7fee2f479700 0 -- 172.21.15.134:0/4091507212 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55d7ccf7e340 msgr2=0x55d7ccf595f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:36.805 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:36.807 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T04:23:36.857 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 rbd2/test2 2023-12-06T04:23:36.945 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:36.945+0000 7f5824c3b700 0 -- 172.21.15.134:0/2744051549 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f5808036d00 msgr2=0x7f5808039130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:37.150 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-12-06T04:23:37.196 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:37.200 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:37.200 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-12-06T04:23:37.208 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort test2 2023-12-06T04:23:37.303 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-12-06T04:23:37.306 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:37.347 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:37.349 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:37.349 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 1000.02 bytes/sec: 1000 KiB/s 2023-12-06T04:23:37.357 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:37.473 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T04:23:37.473+0000 7fab4b3a3700 0 -- 172.21.15.134:0/914782484 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fab28008780 msgr2=0x7fab2800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:37.474 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:37.477 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T04:23:37.518 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 rbd2/test2 2023-12-06T04:23:37.630 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort rbd2/test2 2023-12-06T04:23:37.721 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-12-06T04:23:37.724 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:37.765 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:37.773 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:37.773 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 142.86 bytes/sec: 143 KiB/s 2023-12-06T04:23:37.789 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:37.907 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T04:23:37.906+0000 7f7692389700 0 -- 172.21.15.134:0/1224815926 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x563d921a2870 msgr2=0x563d921c6770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:37.907 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:37.909 INFO:tasks.workunit.client.0.smithi134.stderr:+ test 2 = 1 2023-12-06T04:23:37.909 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 128M --image-format 2 test2 2023-12-06T04:23:37.949 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration prepare test2 rbd2/ns1/test3 2023-12-06T04:23:38.051 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:38.050+0000 7f9f1503f700 0 -- 172.21.15.134:0/1003812221 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x564d39941da0 msgr2=0x564d39944190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:38.057 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/ns1/test3 2023-12-06T04:23:38.101 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:38.109 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:38.109 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-12-06T04:23:38.117 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd migration abort test2 2023-12-06T04:23:38.230 INFO:tasks.workunit.client.0.smithi134.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-12-06T04:23:38.232 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-12-06T04:23:38.272 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-12-06T04:23:38.274 INFO:tasks.workunit.client.0.smithi134.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-12-06T04:23:38.274 INFO:tasks.workunit.client.0.smithi134.stdout:elapsed: 0 ops: 1 ops/sec: 500.012 bytes/sec: 500 KiB/s 2023-12-06T04:23:38.281 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:23:38.395 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T04:23:38.395+0000 7fe4b678d700 0 -- 172.21.15.134:0/2096936032 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x56040753b930 msgr2=0x56040755e160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:38.396 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:38.398 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:23:38.398 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:38.488 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:38.567 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:38.645 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:38.718 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:38.791 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:38.867 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:38.942 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.021 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.301 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.378 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.457 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.534 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.610 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.682 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.753 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.828 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.903 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:39.979 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-12-06T04:23:40.708 INFO:tasks.workunit.client.0.smithi134.stderr:pool 'rbd2' does not exist 2023-12-06T04:23:40.717 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_config 2023-12-06T04:23:40.717 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing config...' 2023-12-06T04:23:40.718 INFO:tasks.workunit.client.0.smithi134.stdout:testing config... 2023-12-06T04:23:40.718 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:23:40.718 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:40.799 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:40.873 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:40.944 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.016 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.091 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.165 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.236 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.310 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.385 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.459 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.535 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.610 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.685 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.761 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.836 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.912 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:41.987 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:42.064 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd config global set osd rbd_cache true 2023-12-06T04:23:42.064 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global set osd rbd_cache true 2023-12-06T04:23:42.086 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: invalid config entity: osd (must be global, client or client.) 2023-12-06T04:23:42.087 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:42.087 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd config global set global debug_ms 10 2023-12-06T04:23:42.088 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global set global debug_ms 10 2023-12-06T04:23:42.109 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: not rbd option: debug_ms 2023-12-06T04:23:42.110 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:42.110 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd config global set global rbd_UNKNOWN false 2023-12-06T04:23:42.110 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global set global rbd_UNKNOWN false 2023-12-06T04:23:42.132 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: invalid config key: rbd_UNKNOWN 2023-12-06T04:23:42.133 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:42.133 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd config global set global rbd_cache INVALID 2023-12-06T04:23:42.133 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global set global rbd_cache INVALID 2023-12-06T04:23:42.159 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: error setting rbd_cache: error parsing value: Expected option value to be integer, got 'INVALID' 2023-12-06T04:23:42.161 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:42.161 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global set global rbd_cache false 2023-12-06T04:23:42.194 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global set client rbd_cache true 2023-12-06T04:23:42.225 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global set client.123 rbd_cache false 2023-12-06T04:23:42.256 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global get global rbd_cache 2023-12-06T04:23:42.256 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^false$' 2023-12-06T04:23:42.284 INFO:tasks.workunit.client.0.smithi134.stdout:false 2023-12-06T04:23:42.285 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global get client rbd_cache 2023-12-06T04:23:42.285 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^true$' 2023-12-06T04:23:42.312 INFO:tasks.workunit.client.0.smithi134.stdout:true 2023-12-06T04:23:42.312 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global get client.123 rbd_cache 2023-12-06T04:23:42.312 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^false$' 2023-12-06T04:23:42.340 INFO:tasks.workunit.client.0.smithi134.stdout:false 2023-12-06T04:23:42.341 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd config global get client.UNKNOWN rbd_cache 2023-12-06T04:23:42.341 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global get client.UNKNOWN rbd_cache 2023-12-06T04:23:42.367 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: rbd_cache is not set 2023-12-06T04:23:42.368 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:42.369 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global list global 2023-12-06T04:23:42.369 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * false * global *$' 2023-12-06T04:23:42.396 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache false global 2023-12-06T04:23:42.396 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global list client 2023-12-06T04:23:42.396 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * true * client *$' 2023-12-06T04:23:42.423 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache true client 2023-12-06T04:23:42.424 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global list client.123 2023-12-06T04:23:42.424 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * false * client.123 *$' 2023-12-06T04:23:42.450 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache false client.123 2023-12-06T04:23:42.451 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global list client.UNKNOWN 2023-12-06T04:23:42.451 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * true * client *$' 2023-12-06T04:23:42.478 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache true client 2023-12-06T04:23:42.478 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global rm client rbd_cache 2023-12-06T04:23:42.509 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd config global get client rbd_cache 2023-12-06T04:23:42.509 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global get client rbd_cache 2023-12-06T04:23:42.537 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: rbd_cache is not set 2023-12-06T04:23:42.538 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:42.538 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global list client 2023-12-06T04:23:42.539 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * false * global *$' 2023-12-06T04:23:42.597 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache false global 2023-12-06T04:23:42.597 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global rm client.123 rbd_cache 2023-12-06T04:23:42.627 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config global rm global rbd_cache 2023-12-06T04:23:42.659 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config pool set rbd rbd_cache true 2023-12-06T04:23:42.695 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config pool list rbd 2023-12-06T04:23:42.696 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * true * pool *$' 2023-12-06T04:23:42.723 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache true pool 2023-12-06T04:23:42.723 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config pool get rbd rbd_cache 2023-12-06T04:23:42.724 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^true$' 2023-12-06T04:23:42.752 INFO:tasks.workunit.client.0.smithi134.stdout:true 2023-12-06T04:23:42.752 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 1 test1 2023-12-06T04:23:42.778 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:42.777+0000 7fdaea304380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:42.785 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config image list rbd/test1 2023-12-06T04:23:42.785 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * true * pool *$' 2023-12-06T04:23:42.821 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache true pool 2023-12-06T04:23:42.822 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config image set rbd/test1 rbd_cache false 2023-12-06T04:23:42.862 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config image list rbd/test1 2023-12-06T04:23:42.863 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * false * image *$' 2023-12-06T04:23:42.898 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache false image 2023-12-06T04:23:42.898 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-12-06T04:23:42.898 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^false$' 2023-12-06T04:23:42.934 INFO:tasks.workunit.client.0.smithi134.stdout:false 2023-12-06T04:23:42.934 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config image remove rbd/test1 rbd_cache 2023-12-06T04:23:42.973 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd config image get rbd/test1 rbd_cache 2023-12-06T04:23:42.973 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-12-06T04:23:43.004 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: rbd_cache is not set 2023-12-06T04:23:43.008 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:43.008 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config image list rbd/test1 2023-12-06T04:23:43.008 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * true * pool *$' 2023-12-06T04:23:43.044 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache true pool 2023-12-06T04:23:43.045 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config pool remove rbd rbd_cache 2023-12-06T04:23:43.079 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd config pool get rbd rbd_cache 2023-12-06T04:23:43.079 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config pool get rbd rbd_cache 2023-12-06T04:23:43.105 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: rbd_cache is not set 2023-12-06T04:23:43.108 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:23:43.108 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd config pool list rbd 2023-12-06T04:23:43.108 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^rbd_cache * true * config *$' 2023-12-06T04:23:43.136 INFO:tasks.workunit.client.0.smithi134.stdout:rbd_cache true config 2023-12-06T04:23:43.136 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:23:43.172 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:43.175 INFO:tasks.workunit.client.0.smithi134.stderr:+ RBD_CREATE_ARGS= 2023-12-06T04:23:43.175 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_others 2023-12-06T04:23:43.175 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-12-06T04:23:43.175 INFO:tasks.workunit.client.0.smithi134.stdout:testing import, export, resize, and snapshots... 2023-12-06T04:23:43.176 INFO:tasks.workunit.client.0.smithi134.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-12-06T04:23:43.176 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:23:43.176 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.248 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.320 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.392 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.465 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.542 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.615 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.686 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.758 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.832 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.906 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:43.979 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:44.051 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:44.124 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:44.196 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:44.268 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:44.340 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:44.416 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:44.491 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-12-06T04:23:44.492 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-12-06T04:23:44.493 INFO:tasks.workunit.client.0.smithi134.stderr:1+0 records in 2023-12-06T04:23:44.493 INFO:tasks.workunit.client.0.smithi134.stderr:1+0 records out 2023-12-06T04:23:44.493 INFO:tasks.workunit.client.0.smithi134.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.0131e-05 s, 25.5 MB/s 2023-12-06T04:23:44.493 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-12-06T04:23:44.493 INFO:tasks.workunit.client.0.smithi134.stderr:10+0 records in 2023-12-06T04:23:44.493 INFO:tasks.workunit.client.0.smithi134.stderr:10+0 records out 2023-12-06T04:23:44.493 INFO:tasks.workunit.client.0.smithi134.stderr:10240 bytes (10 kB, 10 KiB) copied, 6.4497e-05 s, 159 MB/s 2023-12-06T04:23:44.494 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-12-06T04:23:44.494 INFO:tasks.workunit.client.0.smithi134.stderr:70+1 records in 2023-12-06T04:23:44.494 INFO:tasks.workunit.client.0.smithi134.stderr:70+1 records out 2023-12-06T04:23:44.494 INFO:tasks.workunit.client.0.smithi134.stderr:72208 bytes (72 kB, 71 KiB) copied, 0.000161192 s, 448 MB/s 2023-12-06T04:23:44.494 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-12-06T04:23:44.495 INFO:tasks.workunit.client.0.smithi134.stderr:140+1 records in 2023-12-06T04:23:44.495 INFO:tasks.workunit.client.0.smithi134.stderr:140+1 records out 2023-12-06T04:23:44.495 INFO:tasks.workunit.client.0.smithi134.stderr:143376 bytes (143 kB, 140 KiB) copied, 0.000309475 s, 463 MB/s 2023-12-06T04:23:44.496 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-12-06T04:23:44.496 INFO:tasks.workunit.client.0.smithi134.stderr:70+1 records in 2023-12-06T04:23:44.496 INFO:tasks.workunit.client.0.smithi134.stderr:70+1 records out 2023-12-06T04:23:44.496 INFO:tasks.workunit.client.0.smithi134.stderr:72312 bytes (72 kB, 71 KiB) copied, 0.000176801 s, 409 MB/s 2023-12-06T04:23:44.496 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import /tmp/img1 testimg1 2023-12-06T04:23:44.523 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:44.523+0000 7fe1f66dd380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:44.600 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-12-06T04:23:44.604 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-12-06T04:23:44.637 INFO:tasks.workunit.client.0.smithi134.stderr: Resizing image: 100% complete...done. 2023-12-06T04:23:44.642 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg1 /tmp/img2 2023-12-06T04:23:44.740 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:44.743 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg1 --snap=snap1 2023-12-06T04:23:45.514 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:23:45.520 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd resize testimg1 --size=128 2023-12-06T04:23:45.557 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-12-06T04:23:45.563 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:23:45.563 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-12-06T04:23:45.610 INFO:tasks.workunit.client.0.smithi134.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-12-06T04:23:45.615 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg1 /tmp/img3 2023-12-06T04:23:45.676 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:45.679 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg1 2023-12-06T04:23:45.679 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:23:45.709 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:23:45.710 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T04:23:45.710 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:23:45.740 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:23:45.741 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-12-06T04:23:45.741 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-12-06T04:23:45.833 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:45.839 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-12-06T04:23:45.892 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 100% complete...done. 2023-12-06T04:23:45.895 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --size=1 testimg-diff1 2023-12-06T04:23:45.921 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:45.921+0000 7f6f1fd88380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:45.928 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-12-06T04:23:46.529 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-12-06T04:23:46.534 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-12-06T04:23:46.594 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-12-06T04:23:46.599 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg1 2023-12-06T04:23:46.599 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:23:46.631 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:23:46.631 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T04:23:46.631 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:23:46.662 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:23:46.662 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg-diff1 2023-12-06T04:23:46.662 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:23:46.692 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:23:46.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-12-06T04:23:46.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:23:46.723 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:23:46.724 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-12-06T04:23:46.825 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:23:46.828 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy testimg1 testimg3 2023-12-06T04:23:46.910 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:23:46.917 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-12-06T04:23:47.018 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:23:47.021 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-12-06T04:23:47.098 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:23:47.101 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg2 2023-12-06T04:23:47.101 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:23:47.134 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:23:47.134 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg3 2023-12-06T04:23:47.135 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:23:47.167 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:23:47.167 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg-diff2 2023-12-06T04:23:47.167 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:23:47.199 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:23:47.200 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg-diff3 2023-12-06T04:23:47.200 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:23:47.233 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:23:47.233 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd deep copy testimg1 testimg4 2023-12-06T04:23:47.568 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T04:23:47.571 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-12-06T04:23:48.616 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T04:23:48.620 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg4 2023-12-06T04:23:48.620 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:23:48.660 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:23:48.660 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg5 2023-12-06T04:23:48.660 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:23:48.692 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:23:48.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls testimg4 2023-12-06T04:23:48.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v SNAPID 2023-12-06T04:23:48.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:23:48.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:23:48.725 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:23:48.725 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls testimg4 2023-12-06T04:23:48.725 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '.*snap1.*' 2023-12-06T04:23:48.757 INFO:tasks.workunit.client.0.smithi134.stdout: 18 snap1 256 MiB Wed Dec 6 04:23:47 2023 2023-12-06T04:23:48.758 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg1 /tmp/img1.new 2023-12-06T04:23:48.826 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:48.829 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg2 /tmp/img2.new 2023-12-06T04:23:48.926 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:48.929 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg3 /tmp/img3.new 2023-12-06T04:23:48.995 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:48.998 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-12-06T04:23:49.064 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:49.066 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-12-06T04:23:49.166 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:49.168 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-12-06T04:23:49.235 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:49.237 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-12-06T04:23:49.428 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-12-06T04:23:49.521 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-12-06T04:23:49.680 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-12-06T04:23:49.759 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-12-06T04:23:49.847 INFO:tasks.workunit.client.0.smithi134.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-12-06T04:23:49.853 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-12-06T04:23:49.939 INFO:tasks.workunit.client.0.smithi134.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-12-06T04:23:49.951 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg1 2023-12-06T04:23:49.951 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:23:49.982 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:23:49.982 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg-diff1 2023-12-06T04:23:49.982 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:23:50.012 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:23:50.012 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-12-06T04:23:50.113 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:50.116 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-12-06T04:23:50.221 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:23:50.224 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-12-06T04:23:50.372 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-12-06T04:23:50.519 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm testimg2 2023-12-06T04:23:50.618 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-12-06T04:23:50.617+0000 7f2285c6f700 0 -- 172.21.15.134:0/3738024307 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x55821c59f600 msgr2=0x55821c640130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:23:50.632 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:50.635 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm testimg3 2023-12-06T04:23:50.724 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-12-06T04:23:50.727 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create testimg2 -s 0 2023-12-06T04:23:50.754 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:50.752+0000 7f3716206380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:50.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd cp testimg2 testimg3 2023-12-06T04:23:50.821 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 100% complete...done. 2023-12-06T04:23:50.824 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd deep cp testimg2 testimg6 2023-12-06T04:23:50.878 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 100% complete...done. 2023-12-06T04:23:50.881 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-12-06T04:23:51.562 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:23:51.569 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-12-06T04:23:52.563 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:23:52.570 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T04:23:52.570 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-12-06T04:23:52.605 INFO:tasks.workunit.client.0.smithi134.stdout:error setting snapshot context: (2) No such file or directory 2023-12-06T04:23:52.605 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-12-06T04:23:52.605 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-12-06T04:23:52.637 INFO:tasks.workunit.client.0.smithi134.stdout:error setting snapshot context: (2) No such file or directory 2023-12-06T04:23:52.637 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd sparsify testimg1 2023-12-06T04:23:52.736 INFO:tasks.workunit.client.0.smithi134.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-12-06T04:23:52.742 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:23:52.742 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:52.861 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:52.934 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:53.050 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:53.670 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:54.721 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:54.837 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:54.951 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:55.108 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:55.245 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:55.320 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:55.401 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:55.676 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:55.752 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:55.825 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:55.898 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:55.978 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:56.256 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:56.334 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-12-06T04:23:56.439 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_locking 2023-12-06T04:23:56.440 INFO:tasks.workunit.client.0.smithi134.stdout:testing locking... 2023-12-06T04:23:56.440 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing locking...' 2023-12-06T04:23:56.440 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:23:56.440 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:56.518 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:56.592 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:56.666 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:56.741 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:56.816 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:56.889 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:56.963 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.041 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.117 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.191 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.264 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.340 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.415 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.489 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.566 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.639 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.714 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:57.790 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create -s 1 test1 2023-12-06T04:23:57.816 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:23:57.814+0000 7f8cd63a1380 -1 librbd: Forced V1 image creation. 2023-12-06T04:23:57.824 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:23:57.824 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:23:57.824 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:23:57.858 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:23:57.858 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock add test1 id 2023-12-06T04:23:57.897 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:23:57.897 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep ' 1 ' 2023-12-06T04:23:57.927 INFO:tasks.workunit.client.0.smithi134.stdout:There is 1 exclusive lock on this image. 2023-12-06T04:23:57.928 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd lock list test1 2023-12-06T04:23:57.928 INFO:tasks.workunit.client.0.smithi134.stderr:++ tail -n 1 2023-12-06T04:23:57.928 INFO:tasks.workunit.client.0.smithi134.stderr:++ awk '{print $1;}' 2023-12-06T04:23:57.958 INFO:tasks.workunit.client.0.smithi134.stderr:+ LOCKER=client.7769 2023-12-06T04:23:57.959 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock remove test1 id client.7769 2023-12-06T04:23:58.585 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:23:58.585 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:23:58.585 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:23:58.618 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:23:58.619 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock add test1 id --shared tag 2023-12-06T04:23:58.661 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:23:58.661 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep ' 1 ' 2023-12-06T04:23:58.693 INFO:tasks.workunit.client.0.smithi134.stdout:There is 1 shared lock on this image. 2023-12-06T04:23:58.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock add test1 id --shared tag 2023-12-06T04:23:58.735 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:23:58.735 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep ' 2 ' 2023-12-06T04:23:58.765 INFO:tasks.workunit.client.0.smithi134.stdout:There are 2 shared locks on this image. 2023-12-06T04:23:58.765 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock add test1 id2 --shared tag 2023-12-06T04:23:58.805 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:23:58.806 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep ' 3 ' 2023-12-06T04:23:58.836 INFO:tasks.workunit.client.0.smithi134.stdout:There are 3 shared locks on this image. 2023-12-06T04:23:58.837 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:23:58.837 INFO:tasks.workunit.client.0.smithi134.stderr:+ tail -n 1 2023-12-06T04:23:58.837 INFO:tasks.workunit.client.0.smithi134.stderr:+ awk '{print $2, $1;}' 2023-12-06T04:23:58.837 INFO:tasks.workunit.client.0.smithi134.stderr:+ xargs rbd lock remove test1 2023-12-06T04:23:59.593 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info test1 2023-12-06T04:23:59.593 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -qE 'features:.*exclusive' 2023-12-06T04:23:59.624 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:23:59.863 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:23:59.865 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_thick_provision 2023-12-06T04:23:59.865 INFO:tasks.workunit.client.0.smithi134.stdout:testing thick provision... 2023-12-06T04:23:59.866 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing thick provision...' 2023-12-06T04:23:59.866 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:23:59.866 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:23:59.940 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.015 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.088 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.162 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.236 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.314 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.393 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.470 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.545 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.623 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.698 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.772 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.844 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.917 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:00.991 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:01.064 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:01.137 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:01.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --thick-provision -s 64M test1 2023-12-06T04:24:01.242 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:01.241+0000 7f3152d1d380 -1 librbd: Forced V1 image creation. 2023-12-06T04:24:01.506 INFO:tasks.workunit.client.0.smithi134.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-12-06T04:24:01.521 INFO:tasks.workunit.client.0.smithi134.stderr:+ count=0 2023-12-06T04:24:01.521 INFO:tasks.workunit.client.0.smithi134.stderr:+ ret= 2023-12-06T04:24:01.521 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 -lt 10 ']' 2023-12-06T04:24:01.521 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd du 2023-12-06T04:24:01.521 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:24:01.521 INFO:tasks.workunit.client.0.smithi134.stderr:+ tr -s ' ' 2023-12-06T04:24:01.521 INFO:tasks.workunit.client.0.smithi134.stderr:+ cut -d ' ' -f 4-5 2023-12-06T04:24:01.522 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^64 MiB' 2023-12-06T04:24:01.740 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:01.739+0000 7f0b9ab50700 0 --2- 172.21.15.134:0/1696994848 >> v2:172.21.15.134:3300/0 conn(0x5644994b3620 0x5644994b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-06T04:24:01.749 INFO:tasks.workunit.client.0.smithi134.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-12-06T04:24:01.754 INFO:tasks.workunit.client.0.smithi134.stdout:64 MiB 2023-12-06T04:24:01.754 INFO:tasks.workunit.client.0.smithi134.stderr:+ ret=0 2023-12-06T04:24:01.754 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 = 0 ']' 2023-12-06T04:24:01.755 INFO:tasks.workunit.client.0.smithi134.stderr:+ break 2023-12-06T04:24:01.755 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd du 2023-12-06T04:24:01.781 INFO:tasks.workunit.client.0.smithi134.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-12-06T04:24:01.782 INFO:tasks.workunit.client.0.smithi134.stdout:NAME PROVISIONED USED 2023-12-06T04:24:01.783 INFO:tasks.workunit.client.0.smithi134.stdout:test1 64 MiB 64 MiB 2023-12-06T04:24:01.785 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 '!=' 0 ']' 2023-12-06T04:24:01.785 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:24:01.854 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete... Removing image: 100% complete...done. 2023-12-06T04:24:01.858 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:24:01.858 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:01.858 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:24:01.858 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:01.886 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:01.887 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --thick-provision -s 4G test1 2023-12-06T04:24:01.913 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:01.912+0000 7f739a06d380 -1 librbd: Forced V1 image creation. 2023-12-06T04:24:02.846 INFO:tasks.workunit.client.0.smithi134.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete... Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete...2023-12-06T04:24:02.844+0000 7f7389680700 0 -- 172.21.15.134:0/1496785668 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x55f3c5a42920 msgr2=0x55f3c5a44d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:03.021 INFO:tasks.workunit.client.0.smithi134.stderr: Thick provisioning: 12% complete... Thick provisioning: 13% complete...2023-12-06T04:24:03.020+0000 7f7389680700 0 -- 172.21.15.134:0/1496785668 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f736c036520 msgr2=0x7f736c038910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:11.226 INFO:tasks.workunit.client.0.smithi134.stderr: Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-12-06T04:24:11.231 INFO:tasks.workunit.client.0.smithi134.stderr:+ count=0 2023-12-06T04:24:11.231 INFO:tasks.workunit.client.0.smithi134.stderr:+ ret= 2023-12-06T04:24:11.231 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 -lt 10 ']' 2023-12-06T04:24:11.231 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd du 2023-12-06T04:24:11.231 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:24:11.231 INFO:tasks.workunit.client.0.smithi134.stderr:+ tr -s ' ' 2023-12-06T04:24:11.231 INFO:tasks.workunit.client.0.smithi134.stderr:+ cut -d ' ' -f 4-5 2023-12-06T04:24:11.231 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^4 GiB' 2023-12-06T04:24:11.258 INFO:tasks.workunit.client.0.smithi134.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-12-06T04:24:11.270 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:11.268+0000 7f97465f9700 0 -- 172.21.15.134:0/1998547518 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55d022e61a40 msgr2=0x55d022e63e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:11.272 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:11.271+0000 7f97465f9700 0 -- 172.21.15.134:0/1998547518 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f97280363a0 msgr2=0x7f97280387d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:11.416 INFO:tasks.workunit.client.0.smithi134.stdout:4 GiB 2023-12-06T04:24:11.417 INFO:tasks.workunit.client.0.smithi134.stderr:+ ret=0 2023-12-06T04:24:11.417 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 = 0 ']' 2023-12-06T04:24:11.417 INFO:tasks.workunit.client.0.smithi134.stderr:+ break 2023-12-06T04:24:11.417 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd du 2023-12-06T04:24:11.443 INFO:tasks.workunit.client.0.smithi134.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-12-06T04:24:11.455 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:11.454+0000 7f2de5157700 0 -- 172.21.15.134:0/2530878431 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55dcec98ae50 msgr2=0x55dcec98d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:11.458 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:11.457+0000 7f2de5157700 0 -- 172.21.15.134:0/2530878431 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f2dc80363b0 msgr2=0x7f2dc80387e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:11.581 INFO:tasks.workunit.client.0.smithi134.stdout:NAME PROVISIONED USED 2023-12-06T04:24:11.581 INFO:tasks.workunit.client.0.smithi134.stdout:test1 4 GiB 4 GiB 2023-12-06T04:24:11.583 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 '!=' 0 ']' 2023-12-06T04:24:11.584 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:24:11.706 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete...2023-12-06T04:24:11.704+0000 7fbe282a1700 0 -- 172.21.15.134:0/1091535199 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x563b7d881150 msgr2=0x563b7d883540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:11.726 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 12% complete...2023-12-06T04:24:11.724+0000 7fbe282a1700 0 -- 172.21.15.134:0/1091535199 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fbe0c036480 msgr2=0x7fbe0c0388b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:24:12.544 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-12-06T04:24:12.547 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:12.547 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:24:12.547 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:12.547 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:24:12.574 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:12.575 INFO:tasks.workunit.client.0.smithi134.stderr:+ RBD_CREATE_ARGS='--image-format 2' 2023-12-06T04:24:12.575 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_others 2023-12-06T04:24:12.575 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-12-06T04:24:12.575 INFO:tasks.workunit.client.0.smithi134.stdout:testing import, export, resize, and snapshots... 2023-12-06T04:24:12.576 INFO:tasks.workunit.client.0.smithi134.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-12-06T04:24:12.576 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:24:12.576 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:12.649 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:12.723 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:12.797 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:12.871 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:12.947 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.020 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.093 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.167 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.240 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.314 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.392 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.467 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.542 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.616 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.689 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.765 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.839 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:13.915 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-12-06T04:24:13.915 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-12-06T04:24:13.916 INFO:tasks.workunit.client.0.smithi134.stderr:1+0 records in 2023-12-06T04:24:13.916 INFO:tasks.workunit.client.0.smithi134.stderr:1+0 records out 2023-12-06T04:24:13.917 INFO:tasks.workunit.client.0.smithi134.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 4.0164e-05 s, 25.5 MB/s 2023-12-06T04:24:13.917 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-12-06T04:24:13.917 INFO:tasks.workunit.client.0.smithi134.stderr:10+0 records in 2023-12-06T04:24:13.917 INFO:tasks.workunit.client.0.smithi134.stderr:10+0 records out 2023-12-06T04:24:13.917 INFO:tasks.workunit.client.0.smithi134.stderr:10240 bytes (10 kB, 10 KiB) copied, 5.1908e-05 s, 197 MB/s 2023-12-06T04:24:13.917 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-12-06T04:24:13.918 INFO:tasks.workunit.client.0.smithi134.stderr:70+1 records in 2023-12-06T04:24:13.918 INFO:tasks.workunit.client.0.smithi134.stderr:70+1 records out 2023-12-06T04:24:13.918 INFO:tasks.workunit.client.0.smithi134.stderr:72208 bytes (72 kB, 71 KiB) copied, 0.000186896 s, 386 MB/s 2023-12-06T04:24:13.918 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-12-06T04:24:13.919 INFO:tasks.workunit.client.0.smithi134.stderr:140+1 records in 2023-12-06T04:24:13.919 INFO:tasks.workunit.client.0.smithi134.stderr:140+1 records out 2023-12-06T04:24:13.919 INFO:tasks.workunit.client.0.smithi134.stderr:143376 bytes (143 kB, 140 KiB) copied, 0.0003154 s, 455 MB/s 2023-12-06T04:24:13.919 INFO:tasks.workunit.client.0.smithi134.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-12-06T04:24:13.920 INFO:tasks.workunit.client.0.smithi134.stderr:70+1 records in 2023-12-06T04:24:13.920 INFO:tasks.workunit.client.0.smithi134.stderr:70+1 records out 2023-12-06T04:24:13.920 INFO:tasks.workunit.client.0.smithi134.stderr:72312 bytes (72 kB, 71 KiB) copied, 0.000164821 s, 439 MB/s 2023-12-06T04:24:13.920 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import --image-format 2 /tmp/img1 testimg1 2023-12-06T04:24:14.043 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-12-06T04:24:14.046 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-12-06T04:24:14.092 INFO:tasks.workunit.client.0.smithi134.stderr: Resizing image: 100% complete...done. 2023-12-06T04:24:14.101 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg1 /tmp/img2 2023-12-06T04:24:14.199 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:14.202 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg1 --snap=snap1 2023-12-06T04:24:14.662 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:24:14.672 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd resize testimg1 --size=128 2023-12-06T04:24:14.710 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-12-06T04:24:14.716 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:24:14.716 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-12-06T04:24:14.761 INFO:tasks.workunit.client.0.smithi134.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-12-06T04:24:14.770 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg1 /tmp/img3 2023-12-06T04:24:14.846 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:14.849 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg1 2023-12-06T04:24:14.849 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:24:14.882 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:24:14.883 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T04:24:14.883 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:24:14.920 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:24:14.920 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-12-06T04:24:14.921 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-12-06T04:24:14.973 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:14.976 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-12-06T04:24:15.086 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 100% complete...done. 2023-12-06T04:24:15.089 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size=1 testimg-diff1 2023-12-06T04:24:15.130 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-12-06T04:24:15.669 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-12-06T04:24:15.679 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-12-06T04:24:15.728 INFO:tasks.workunit.client.0.smithi134.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-12-06T04:24:15.738 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg1 2023-12-06T04:24:15.738 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:24:15.773 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:24:15.773 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T04:24:15.774 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:24:15.809 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:24:15.809 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg-diff1 2023-12-06T04:24:15.810 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:24:15.842 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:24:15.842 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-12-06T04:24:15.842 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:24:15.880 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:24:15.880 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-12-06T04:24:15.976 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:24:15.979 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy testimg1 testimg3 2023-12-06T04:24:16.203 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:16.202+0000 7fb12ff66700 0 --2- 172.21.15.134:0/4292333103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e91f678ad0 0x55e91f716d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-06T04:24:16.282 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:24:16.285 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-12-06T04:24:16.376 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:24:16.379 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-12-06T04:24:16.487 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-12-06T04:24:16.490 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg2 2023-12-06T04:24:16.490 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:24:16.523 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:24:16.523 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg3 2023-12-06T04:24:16.523 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:24:16.555 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:24:16.555 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg-diff2 2023-12-06T04:24:16.555 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:24:16.587 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:24:16.588 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg-diff3 2023-12-06T04:24:16.588 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:24:16.620 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:24:16.620 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd deep copy testimg1 testimg4 2023-12-06T04:24:17.712 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T04:24:17.715 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-12-06T04:24:18.735 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T04:24:18.739 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg4 2023-12-06T04:24:18.739 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 128 MiB' 2023-12-06T04:24:18.773 INFO:tasks.workunit.client.0.smithi134.stdout: size 128 MiB in 32 objects 2023-12-06T04:24:18.773 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg5 2023-12-06T04:24:18.773 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:24:18.805 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:24:18.806 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls testimg4 2023-12-06T04:24:18.806 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v SNAPID 2023-12-06T04:24:18.806 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:18.806 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:18.838 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:18.838 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls testimg4 2023-12-06T04:24:18.838 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '.*snap1.*' 2023-12-06T04:24:18.870 INFO:tasks.workunit.client.0.smithi134.stdout: 26 snap1 256 MiB Wed Dec 6 04:24:17 2023 2023-12-06T04:24:18.871 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg1 /tmp/img1.new 2023-12-06T04:24:18.944 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:18.947 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg2 /tmp/img2.new 2023-12-06T04:24:19.051 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:19.054 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg3 /tmp/img3.new 2023-12-06T04:24:19.121 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:19.124 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-12-06T04:24:19.197 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:19.200 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-12-06T04:24:19.422 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:19.421+0000 7fef45e72700 0 --2- 172.21.15.134:0/664943663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef30001dc0 0x7fef300041f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-06T04:24:19.497 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:19.500 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-12-06T04:24:19.573 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:19.576 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-12-06T04:24:19.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-12-06T04:24:19.863 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-12-06T04:24:20.018 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-12-06T04:24:20.098 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-12-06T04:24:20.202 INFO:tasks.workunit.client.0.smithi134.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-12-06T04:24:20.212 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-12-06T04:24:20.316 INFO:tasks.workunit.client.0.smithi134.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-12-06T04:24:20.324 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg1 2023-12-06T04:24:20.325 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:24:20.358 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:24:20.358 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg-diff1 2023-12-06T04:24:20.358 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:24:20.390 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:24:20.390 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-12-06T04:24:20.493 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:20.497 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-12-06T04:24:20.594 INFO:tasks.workunit.client.0.smithi134.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-12-06T04:24:20.598 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-12-06T04:24:20.746 INFO:tasks.workunit.client.0.smithi134.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-12-06T04:24:20.892 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm testimg2 2023-12-06T04:24:20.993 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-12-06T04:24:20.993+0000 7f0b32ca4700 0 -- 172.21.15.134:0/1091458681 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f0b18008780 msgr2=0x7f0b1800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:20.998 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:21.000 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm testimg3 2023-12-06T04:24:21.090 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-12-06T04:24:21.089+0000 7ff6b4f6a700 0 -- 172.21.15.134:0/2565017283 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7ff698036390 msgr2=0x7ff6980387c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:21.106 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:21.108 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create testimg2 -s 0 2023-12-06T04:24:21.135 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:21.134+0000 7f3e11acf380 -1 librbd: Forced V1 image creation. 2023-12-06T04:24:21.141 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd cp testimg2 testimg3 2023-12-06T04:24:21.194 INFO:tasks.workunit.client.0.smithi134.stderr: Image copy: 100% complete...done. 2023-12-06T04:24:21.198 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd deep cp testimg2 testimg6 2023-12-06T04:24:21.249 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 100% complete...done. 2023-12-06T04:24:21.251 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-12-06T04:24:21.683 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:24:21.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-12-06T04:24:22.700 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:24:22.711 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg1 2023-12-06T04:24:22.711 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-12-06T04:24:22.748 INFO:tasks.workunit.client.0.smithi134.stdout:error setting snapshot context: (2) No such file or directory 2023-12-06T04:24:22.748 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-12-06T04:24:22.748 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-12-06T04:24:22.783 INFO:tasks.workunit.client.0.smithi134.stdout:error setting snapshot context: (2) No such file or directory 2023-12-06T04:24:22.783 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd sparsify testimg1 2023-12-06T04:24:22.844 INFO:tasks.workunit.client.0.smithi134.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-12-06T04:24:22.852 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:24:22.852 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:23.004 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:23.076 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:23.188 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:23.839 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:24.824 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:24.935 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.085 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.233 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.380 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.463 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.541 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.618 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.770 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.844 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.921 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:25.999 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:26.074 INFO:tasks.workunit.client.0.smithi134.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-12-06T04:24:26.180 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_locking 2023-12-06T04:24:26.181 INFO:tasks.workunit.client.0.smithi134.stdout:testing locking... 2023-12-06T04:24:26.181 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing locking...' 2023-12-06T04:24:26.181 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:24:26.181 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:26.257 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:26.332 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:26.607 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:26.682 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:26.757 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:26.830 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:26.906 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:26.984 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.059 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.134 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.209 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.283 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.357 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.432 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.507 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.586 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.661 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:27.736 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T04:24:27.779 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:24:27.779 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:27.779 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:24:27.813 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:27.813 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock add test1 id 2023-12-06T04:24:27.853 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:24:27.853 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep ' 1 ' 2023-12-06T04:24:27.885 INFO:tasks.workunit.client.0.smithi134.stdout:There is 1 exclusive lock on this image. 2023-12-06T04:24:27.886 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd lock list test1 2023-12-06T04:24:27.886 INFO:tasks.workunit.client.0.smithi134.stderr:++ tail -n 1 2023-12-06T04:24:27.886 INFO:tasks.workunit.client.0.smithi134.stderr:++ awk '{print $1;}' 2023-12-06T04:24:27.919 INFO:tasks.workunit.client.0.smithi134.stderr:+ LOCKER=client.8445 2023-12-06T04:24:27.920 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock remove test1 id client.8445 2023-12-06T04:24:28.718 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:24:28.718 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:28.718 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:24:28.757 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:28.757 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock add test1 id --shared tag 2023-12-06T04:24:28.801 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:24:28.801 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep ' 1 ' 2023-12-06T04:24:28.835 INFO:tasks.workunit.client.0.smithi134.stdout:There is 1 shared lock on this image. 2023-12-06T04:24:28.835 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock add test1 id --shared tag 2023-12-06T04:24:28.876 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:24:28.876 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep ' 2 ' 2023-12-06T04:24:28.910 INFO:tasks.workunit.client.0.smithi134.stdout:There are 2 shared locks on this image. 2023-12-06T04:24:28.910 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock add test1 id2 --shared tag 2023-12-06T04:24:28.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:24:28.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep ' 3 ' 2023-12-06T04:24:28.986 INFO:tasks.workunit.client.0.smithi134.stdout:There are 3 shared locks on this image. 2023-12-06T04:24:28.987 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:24:28.987 INFO:tasks.workunit.client.0.smithi134.stderr:+ tail -n 1 2023-12-06T04:24:28.987 INFO:tasks.workunit.client.0.smithi134.stderr:+ awk '{print $2, $1;}' 2023-12-06T04:24:28.987 INFO:tasks.workunit.client.0.smithi134.stderr:+ xargs rbd lock remove test1 2023-12-06T04:24:29.724 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info test1 2023-12-06T04:24:29.724 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -qE 'features:.*exclusive' 2023-12-06T04:24:29.763 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd lock list test1 2023-12-06T04:24:29.798 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' -n 'There are 2 shared locks on this image. 2023-12-06T04:24:29.798 INFO:tasks.workunit.client.0.smithi134.stderr:Lock tag: tag 2023-12-06T04:24:29.798 INFO:tasks.workunit.client.0.smithi134.stderr:Locker ID Address 2023-12-06T04:24:29.799 INFO:tasks.workunit.client.0.smithi134.stderr:client.8460 id 172.21.15.134:0/2178896639 2023-12-06T04:24:29.799 INFO:tasks.workunit.client.0.smithi134.stderr:client.8466 id 172.21.15.134:0/2496821409' ']' 2023-12-06T04:24:29.799 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:24:29.799 INFO:tasks.workunit.client.0.smithi134.stderr:+ tail -n 1 2023-12-06T04:24:29.799 INFO:tasks.workunit.client.0.smithi134.stderr:+ awk '{print $2, $1;}' 2023-12-06T04:24:29.799 INFO:tasks.workunit.client.0.smithi134.stderr:+ xargs rbd lock remove test1 2023-12-06T04:24:30.729 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd lock list test1 2023-12-06T04:24:30.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' -n 'There is 1 shared lock on this image. 2023-12-06T04:24:30.768 INFO:tasks.workunit.client.0.smithi134.stderr:Lock tag: tag 2023-12-06T04:24:30.768 INFO:tasks.workunit.client.0.smithi134.stderr:Locker ID Address 2023-12-06T04:24:30.768 INFO:tasks.workunit.client.0.smithi134.stderr:client.8460 id 172.21.15.134:0/2178896639' ']' 2023-12-06T04:24:30.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd lock list test1 2023-12-06T04:24:30.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ tail -n 1 2023-12-06T04:24:30.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ awk '{print $2, $1;}' 2023-12-06T04:24:30.768 INFO:tasks.workunit.client.0.smithi134.stderr:+ xargs rbd lock remove test1 2023-12-06T04:24:31.737 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd lock list test1 2023-12-06T04:24:31.774 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' -n '' ']' 2023-12-06T04:24:31.775 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:24:31.873 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:31.876 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_clone 2023-12-06T04:24:31.876 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing clone...' 2023-12-06T04:24:31.876 INFO:tasks.workunit.client.0.smithi134.stdout:testing clone... 2023-12-06T04:24:31.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:24:31.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:31.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.027 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.103 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.177 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.252 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.326 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.402 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.477 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.554 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.630 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.704 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.780 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.854 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:32.930 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:33.004 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:33.078 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:33.154 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:33.229 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create test1 --image-format 2 -s 1 2023-12-06T04:24:33.271 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@s1 2023-12-06T04:24:33.750 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:24:33.757 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap protect test1@s1 2023-12-06T04:24:33.797 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd pool create rbd2 8 2023-12-06T04:24:34.856 INFO:tasks.workunit.client.0.smithi134.stderr:pool 'rbd2' already exists 2023-12-06T04:24:34.865 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd pool init rbd2 2023-12-06T04:24:37.761 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone test1@s1 rbd2/clone 2023-12-06T04:24:37.823 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd -p rbd2 ls 2023-12-06T04:24:37.823 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep clone 2023-12-06T04:24:37.851 INFO:tasks.workunit.client.0.smithi134.stdout:clone 2023-12-06T04:24:37.851 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd -p rbd2 ls -l 2023-12-06T04:24:37.851 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep clone 2023-12-06T04:24:37.851 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1@s1 2023-12-06T04:24:37.892 INFO:tasks.workunit.client.0.smithi134.stdout:clone 1 MiB rbd/test1@s1 2 2023-12-06T04:24:37.892 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:37.893 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v clone 2023-12-06T04:24:37.918 INFO:tasks.workunit.client.0.smithi134.stdout:test1 2023-12-06T04:24:37.918 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd flatten rbd2/clone 2023-12-06T04:24:37.958 INFO:tasks.workunit.client.0.smithi134.stderr: Image flatten: 100% complete...done. 2023-12-06T04:24:37.964 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create rbd2/clone@s1 2023-12-06T04:24:38.772 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:24:38.779 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap protect rbd2/clone@s1 2023-12-06T04:24:38.820 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone rbd2/clone@s1 clone2 2023-12-06T04:24:38.886 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:38.886 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep clone2 2023-12-06T04:24:38.912 INFO:tasks.workunit.client.0.smithi134.stdout:clone2 2023-12-06T04:24:38.912 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:24:38.912 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep clone2 2023-12-06T04:24:38.912 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep rbd2/clone@s1 2023-12-06T04:24:38.952 INFO:tasks.workunit.client.0.smithi134.stdout:clone2 1 MiB rbd2/clone@s1 2 2023-12-06T04:24:38.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd -p rbd2 ls 2023-12-06T04:24:38.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v clone2 2023-12-06T04:24:38.979 INFO:tasks.workunit.client.0.smithi134.stdout:clone 2023-12-06T04:24:38.979 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm clone2 2023-12-06T04:24:39.074 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:39.072+0000 7f69e61f6700 0 -- 172.21.15.134:0/872163242 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f69cc008780 msgr2=0x7f69cc00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:39.074 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:39.076 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap unprotect rbd2/clone@s1 2023-12-06T04:24:39.114 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm rbd2/clone@s1 2023-12-06T04:24:39.767 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:24:39.773 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm rbd2/clone 2023-12-06T04:24:39.849 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:39.847+0000 7f3745b21700 0 -- 172.21.15.134:0/974304225 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x5590e41a1760 msgr2=0x5590e41b5fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:39.850 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:39.853 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap unprotect test1@s1 2023-12-06T04:24:39.893 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm test1@s1 2023-12-06T04:24:40.775 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:24:40.788 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:24:41.092 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:24:41.090+0000 7f2ea418d700 0 -- 172.21.15.134:0/372238775 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f2e88008780 msgr2=0x7f2e8800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:24:41.092 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:41.094 INFO:tasks.workunit.client.0.smithi134.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-12-06T04:24:41.879 INFO:tasks.workunit.client.0.smithi134.stderr:pool 'rbd2' does not exist 2023-12-06T04:24:41.889 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_trash 2023-12-06T04:24:41.889 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing trash...' 2023-12-06T04:24:41.889 INFO:tasks.workunit.client.0.smithi134.stdout:testing trash... 2023-12-06T04:24:41.890 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:24:41.890 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:41.971 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.046 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.122 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.198 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.274 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.348 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.423 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.498 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.574 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.648 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.725 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.803 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:42.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:43.026 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:43.102 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:43.177 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:43.253 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T04:24:43.295 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test2 2023-12-06T04:24:43.337 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:43.337 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:24:43.364 INFO:tasks.workunit.client.0.smithi134.stdout:test1 2023-12-06T04:24:43.364 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:43.364 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test2 2023-12-06T04:24:43.390 INFO:tasks.workunit.client.0.smithi134.stdout:test2 2023-12-06T04:24:43.390 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:43.390 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:43.390 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:24:43.416 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:24:43.416 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:24:43.416 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test1.*2.*' 2023-12-06T04:24:43.451 INFO:tasks.workunit.client.0.smithi134.stdout:test1 1 MiB 2 2023-12-06T04:24:43.451 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:24:43.452 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test2.*2.*' 2023-12-06T04:24:43.485 INFO:tasks.workunit.client.0.smithi134.stdout:test2 1 MiB 2 2023-12-06T04:24:43.486 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv test1 2023-12-06T04:24:43.542 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:43.543 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test2 2023-12-06T04:24:43.568 INFO:tasks.workunit.client.0.smithi134.stdout:test2 2023-12-06T04:24:43.569 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:43.569 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:43.569 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:43.595 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:43.595 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:24:43.595 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test2.*2.*' 2023-12-06T04:24:43.628 INFO:tasks.workunit.client.0.smithi134.stdout:test2 1 MiB 2 2023-12-06T04:24:43.628 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:43.628 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:24:43.653 INFO:tasks.workunit.client.0.smithi134.stdout:225d9de367be test1 2023-12-06T04:24:43.654 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:43.654 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:43.654 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:43.682 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:43.682 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls -l 2023-12-06T04:24:43.682 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test1.*USER.*' 2023-12-06T04:24:43.712 INFO:tasks.workunit.client.0.smithi134.stdout:225d9de367be test1 USER Wed Dec 6 04:24:43 2023 expired at Wed Dec 6 04:24:43 2023 2023-12-06T04:24:43.713 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls -l 2023-12-06T04:24:43.713 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v 'protected until' 2023-12-06T04:24:43.746 INFO:tasks.workunit.client.0.smithi134.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-12-06T04:24:43.746 INFO:tasks.workunit.client.0.smithi134.stdout:225d9de367be test1 USER Wed Dec 6 04:24:43 2023 expired at Wed Dec 6 04:24:43 2023 2023-12-06T04:24:43.747 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd trash ls 2023-12-06T04:24:43.747 INFO:tasks.workunit.client.0.smithi134.stderr:++ cut -d ' ' -f 1 2023-12-06T04:24:43.773 INFO:tasks.workunit.client.0.smithi134.stderr:+ ID=225d9de367be 2023-12-06T04:24:43.773 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash rm 225d9de367be 2023-12-06T04:24:43.831 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:43.834 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv test2 2023-12-06T04:24:43.891 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd trash ls 2023-12-06T04:24:43.891 INFO:tasks.workunit.client.0.smithi134.stderr:++ cut -d ' ' -f 1 2023-12-06T04:24:43.917 INFO:tasks.workunit.client.0.smithi134.stderr:+ ID=22606fc17e18 2023-12-06T04:24:43.917 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info --image-id 22606fc17e18 2023-12-06T04:24:43.917 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'rbd image '\''test2'\''' 2023-12-06T04:24:43.950 INFO:tasks.workunit.client.0.smithi134.stdout:rbd image 'test2': 2023-12-06T04:24:43.950 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash restore 22606fc17e18 2023-12-06T04:24:43.987 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:43.987 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test2 2023-12-06T04:24:44.012 INFO:tasks.workunit.client.0.smithi134.stdout:test2 2023-12-06T04:24:44.013 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:24:44.013 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:44.013 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:44.038 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:44.038 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls -l 2023-12-06T04:24:44.039 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test2.*2.*' 2023-12-06T04:24:44.072 INFO:tasks.workunit.client.0.smithi134.stdout:test2 1 MiB 2 2023-12-06T04:24:44.072 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv test2 --expires-at '3600 sec' 2023-12-06T04:24:44.128 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:44.129 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test2 2023-12-06T04:24:44.153 INFO:tasks.workunit.client.0.smithi134.stdout:22606fc17e18 test2 2023-12-06T04:24:44.154 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:44.154 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:44.154 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:44.179 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:44.180 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls -l 2023-12-06T04:24:44.180 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test2.*USER.*protected until' 2023-12-06T04:24:44.213 INFO:tasks.workunit.client.0.smithi134.stdout:22606fc17e18 test2 USER Wed Dec 6 04:24:44 2023 protected until Wed Dec 6 05:24:44 2023 2023-12-06T04:24:44.214 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash rm 22606fc17e18 2023-12-06T04:24:44.214 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'Deferment time has not expired' 2023-12-06T04:24:44.240 INFO:tasks.workunit.client.0.smithi134.stdout:Deferment time has not expired, please use --force if you really want to remove the image2023-12-06T04:24:44.236+0000 7eff14046380 -1 librbd::api::Trash: remove: error: deferment time has not expired. 2023-12-06T04:24:44.240 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash rm --image-id 22606fc17e18 --force 2023-12-06T04:24:44.296 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:44.299 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T04:24:44.340 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@snap1 2023-12-06T04:24:44.447 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:24:44.454 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap protect test1@snap1 2023-12-06T04:24:44.493 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv test1 2023-12-06T04:24:44.546 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:44.547 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:24:44.571 INFO:tasks.workunit.client.0.smithi134.stdout:22b78aaf8fe4 test1 2023-12-06T04:24:44.572 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:44.572 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:44.572 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:44.597 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:44.598 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls -l 2023-12-06T04:24:44.598 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test1.*USER.*' 2023-12-06T04:24:44.631 INFO:tasks.workunit.client.0.smithi134.stdout:22b78aaf8fe4 test1 USER Wed Dec 6 04:24:44 2023 expired at Wed Dec 6 04:24:44 2023 2023-12-06T04:24:44.632 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls -l 2023-12-06T04:24:44.632 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v 'protected until' 2023-12-06T04:24:44.666 INFO:tasks.workunit.client.0.smithi134.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-12-06T04:24:44.666 INFO:tasks.workunit.client.0.smithi134.stdout:22b78aaf8fe4 test1 USER Wed Dec 6 04:24:44 2023 expired at Wed Dec 6 04:24:44 2023 2023-12-06T04:24:44.667 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd trash ls 2023-12-06T04:24:44.667 INFO:tasks.workunit.client.0.smithi134.stderr:++ cut -d ' ' -f 1 2023-12-06T04:24:44.692 INFO:tasks.workunit.client.0.smithi134.stderr:+ ID=22b78aaf8fe4 2023-12-06T04:24:44.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls --image-id 22b78aaf8fe4 2023-12-06T04:24:44.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v SNAPID 2023-12-06T04:24:44.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:44.693 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:44.727 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:44.727 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls --image-id 22b78aaf8fe4 2023-12-06T04:24:44.727 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '.*snap1.*' 2023-12-06T04:24:44.761 INFO:tasks.workunit.client.0.smithi134.stdout: 34 snap1 1 MiB yes Wed Dec 6 04:24:44 2023 2023-12-06T04:24:44.762 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap unprotect --image-id 22b78aaf8fe4 --snap snap1 2023-12-06T04:24:44.805 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm --image-id 22b78aaf8fe4 --snap snap1 2023-12-06T04:24:45.441 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:24:45.449 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls --image-id 22b78aaf8fe4 2023-12-06T04:24:45.449 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v SNAPID 2023-12-06T04:24:45.450 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:45.450 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:24:45.484 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:45.484 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash restore 22b78aaf8fe4 2023-12-06T04:24:45.520 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@snap1 2023-12-06T04:24:46.451 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:24:46.461 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@snap2 2023-12-06T04:24:47.458 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:24:47.468 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls --image-id 22b78aaf8fe4 2023-12-06T04:24:47.468 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v SNAPID 2023-12-06T04:24:47.468 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:47.468 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:24:47.505 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:24:47.506 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap purge --image-id 22b78aaf8fe4 2023-12-06T04:24:49.566 INFO:tasks.workunit.client.0.smithi134.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T04:24:49.583 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls --image-id 22b78aaf8fe4 2023-12-06T04:24:49.584 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v SNAPID 2023-12-06T04:24:49.584 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:49.584 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:24:49.622 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:49.625 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm --rbd_move_to_trash_on_remove=true --rbd_move_to_trash_on_remove_expire_seconds=3600 test1 2023-12-06T04:24:49.678 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:49.681 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:49.681 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:24:49.707 INFO:tasks.workunit.client.0.smithi134.stdout:22b78aaf8fe4 test1 2023-12-06T04:24:49.707 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:49.707 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:49.707 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:49.733 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:49.733 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls -l 2023-12-06T04:24:49.734 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'test1.*USER.*protected until' 2023-12-06T04:24:49.766 INFO:tasks.workunit.client.0.smithi134.stdout:22b78aaf8fe4 test1 USER Wed Dec 6 04:24:49 2023 protected until Wed Dec 6 05:24:49 2023 2023-12-06T04:24:49.766 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash rm 22b78aaf8fe4 2023-12-06T04:24:49.766 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'Deferment time has not expired' 2023-12-06T04:24:49.793 INFO:tasks.workunit.client.0.smithi134.stdout:Deferment time has not expired, please use --force if you really want to remove the image2023-12-06T04:24:49.789+0000 7f3dd8853380 -1 librbd::api::Trash: remove: error: deferment time has not expired. 2023-12-06T04:24:49.793 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash rm --image-id 22b78aaf8fe4 --force 2023-12-06T04:24:49.848 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:24:49.850 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:24:49.850 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:49.926 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.002 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.078 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.154 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.229 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.303 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.379 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.454 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.529 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.606 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.681 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.757 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.834 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.909 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:50.984 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.065 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.140 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.216 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_purge 2023-12-06T04:24:51.216 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing trash purge...' 2023-12-06T04:24:51.216 INFO:tasks.workunit.client.0.smithi134.stdout:testing trash purge... 2023-12-06T04:24:51.216 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:24:51.216 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.493 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.569 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.644 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.720 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.796 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.874 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:51.949 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.025 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.105 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.180 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.255 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.330 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.406 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.482 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.563 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.640 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.716 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:24:52.994 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:52.995 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:52.995 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:24:53.020 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:53.020 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:24:53.043 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 100% complete...done. 2023-12-06T04:24:53.045 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T04:24:53.087 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T04:24:53.130 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg1 2023-12-06T04:24:53.185 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg2 2023-12-06T04:24:53.239 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:53.239 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:53.239 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:24:53.265 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:24:53.265 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:24:53.351 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 50% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:24:53.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:53.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:53.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:24:53.381 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:53.381 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T04:24:53.423 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T04:24:53.467 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg1 --expires-at '1 hour' 2023-12-06T04:24:53.523 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg2 --expires-at '3 hours' 2023-12-06T04:24:53.587 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:53.587 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:53.587 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:24:53.612 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:24:53.612 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:24:53.636 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 100% complete...done. 2023-12-06T04:24:53.638 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:53.639 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:53.639 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:24:53.663 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:24:53.664 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge --expired-before 'now + 2 hours' 2023-12-06T04:24:53.728 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:24:53.731 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:53.731 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:53.731 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:53.756 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:53.757 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:53.757 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg2 2023-12-06T04:24:53.782 INFO:tasks.workunit.client.0.smithi134.stdout:23fb6665b474 testimg2 2023-12-06T04:24:53.782 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge --expired-before 'now + 4 hours' 2023-12-06T04:24:53.843 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:24:53.846 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:53.846 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:53.846 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:24:53.872 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:53.872 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T04:24:53.914 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg1@snap 2023-12-06T04:24:54.583 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:24:54.591 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T04:24:54.635 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T04:24:54.682 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg1 2023-12-06T04:24:54.734 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg2 2023-12-06T04:24:54.804 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg3 2023-12-06T04:24:54.862 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:54.862 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:54.862 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 3 2023-12-06T04:24:54.888 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:24:54.888 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:24:54.888 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:24:55.024 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:24:55.024 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:55.024 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:55.025 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:55.049 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:55.050 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:55.050 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg1 2023-12-06T04:24:55.075 INFO:tasks.workunit.client.0.smithi134.stdout:241c87577495 testimg1 2023-12-06T04:24:55.075 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd trash ls 2023-12-06T04:24:55.075 INFO:tasks.workunit.client.0.smithi134.stderr:++ awk '{ print $1 }' 2023-12-06T04:24:55.101 INFO:tasks.workunit.client.0.smithi134.stderr:+ ID=241c87577495 2023-12-06T04:24:55.101 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap purge --image-id 241c87577495 2023-12-06T04:24:55.579 INFO:tasks.workunit.client.0.smithi134.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T04:24:55.597 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:24:55.649 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:24:55.651 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:55.651 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:55.652 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:24:55.677 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:55.677 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T04:24:55.721 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T04:24:55.765 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg2@snap 2023-12-06T04:24:56.601 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:24:56.610 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T04:24:56.661 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg1 2023-12-06T04:24:56.723 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg2 2023-12-06T04:24:56.780 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg3 2023-12-06T04:24:56.840 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:56.840 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:56.840 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 3 2023-12-06T04:24:56.865 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:24:56.866 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:24:56.866 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:24:57.001 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:24:57.001 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:57.001 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:57.001 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:57.026 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:57.027 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:57.027 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg2 2023-12-06T04:24:57.052 INFO:tasks.workunit.client.0.smithi134.stdout:244c5aeff308 testimg2 2023-12-06T04:24:57.053 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd trash ls 2023-12-06T04:24:57.053 INFO:tasks.workunit.client.0.smithi134.stderr:++ awk '{ print $1 }' 2023-12-06T04:24:57.079 INFO:tasks.workunit.client.0.smithi134.stderr:+ ID=244c5aeff308 2023-12-06T04:24:57.079 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap purge --image-id 244c5aeff308 2023-12-06T04:24:57.557 INFO:tasks.workunit.client.0.smithi134.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T04:24:57.576 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:24:57.635 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:24:57.638 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:57.638 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:57.638 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:24:57.663 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:57.664 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T04:24:57.705 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-12-06T04:24:57.751 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T04:24:57.796 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg3@snap 2023-12-06T04:24:58.596 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:24:58.605 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg1 2023-12-06T04:24:58.676 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg2 2023-12-06T04:24:58.734 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg3 2023-12-06T04:24:58.794 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:58.794 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:58.795 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 3 2023-12-06T04:24:58.820 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:24:58.820 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:24:58.820 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:24:58.968 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:24:58.969 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:58.969 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:58.969 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:24:58.994 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:24:58.995 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:58.995 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg3 2023-12-06T04:24:59.020 INFO:tasks.workunit.client.0.smithi134.stdout:247cd1da7eb6 testimg3 2023-12-06T04:24:59.020 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd trash ls 2023-12-06T04:24:59.020 INFO:tasks.workunit.client.0.smithi134.stderr:++ awk '{ print $1 }' 2023-12-06T04:24:59.046 INFO:tasks.workunit.client.0.smithi134.stderr:+ ID=247cd1da7eb6 2023-12-06T04:24:59.046 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap purge --image-id 247cd1da7eb6 2023-12-06T04:24:59.596 INFO:tasks.workunit.client.0.smithi134.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T04:24:59.606 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:24:59.665 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:24:59.667 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:24:59.668 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:24:59.668 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:24:59.694 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:24:59.694 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T04:24:59.739 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg1@snap 2023-12-06T04:25:00.611 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:00.622 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-12-06T04:25:00.696 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg1@snap 2023-12-06T04:25:00.738 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:00.747 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T04:25:00.789 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg2@snap 2023-12-06T04:25:01.610 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:01.620 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-12-06T04:25:01.698 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-12-06T04:25:01.778 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg2@snap 2023-12-06T04:25:01.824 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:01.831 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg4@snap 2023-12-06T04:25:02.615 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:02.626 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-12-06T04:25:02.709 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg4@snap 2023-12-06T04:25:02.761 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:02.769 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg1 2023-12-06T04:25:02.827 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg2 2023-12-06T04:25:02.883 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg3 2023-12-06T04:25:02.939 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg4 2023-12-06T04:25:02.996 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:02.996 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:02.996 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:03.022 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:03.022 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:03.022 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:03.224 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:03.224 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:03.224 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:03.224 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 3 2023-12-06T04:25:03.250 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:25:03.250 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:03.250 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg1 2023-12-06T04:25:03.276 INFO:tasks.workunit.client.0.smithi134.stdout:24a39042e7e4 testimg1 2023-12-06T04:25:03.276 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:03.276 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg2 2023-12-06T04:25:03.301 INFO:tasks.workunit.client.0.smithi134.stdout:24a962badb80 testimg2 2023-12-06T04:25:03.302 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:03.302 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg4 2023-12-06T04:25:03.327 INFO:tasks.workunit.client.0.smithi134.stdout:24b5a56a88f6 testimg4 2023-12-06T04:25:03.327 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg6 2023-12-06T04:25:03.384 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:03.384 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:03.384 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:03.409 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:03.409 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:03.409 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:03.769 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:03.770 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:03.770 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:03.770 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:25:03.795 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:25:03.795 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:03.795 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg1 2023-12-06T04:25:03.821 INFO:tasks.workunit.client.0.smithi134.stdout:24a39042e7e4 testimg1 2023-12-06T04:25:03.821 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:03.821 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg2 2023-12-06T04:25:03.847 INFO:tasks.workunit.client.0.smithi134.stdout:24a962badb80 testimg2 2023-12-06T04:25:03.847 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg5 2023-12-06T04:25:03.904 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:03.904 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:03.904 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 3 2023-12-06T04:25:03.930 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:25:03.930 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:04.019 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:04.018+0000 7f54d45f7700 0 -- 172.21.15.134:0/3406552014 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f54b4036810 msgr2=0x7f54b4038c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:04.029 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:04.029+0000 7f54d4df8700 0 -- 172.21.15.134:0/3406552014 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x5567897633a0 msgr2=0x556789804f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:05.694 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:25:05.697 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:05.697 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:05.697 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:25:05.724 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:25:05.724 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T04:25:05.767 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg1@snap 2023-12-06T04:25:06.634 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:06.645 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-12-06T04:25:06.725 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg1@snap 2023-12-06T04:25:06.767 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:06.774 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T04:25:06.821 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg3@snap 2023-12-06T04:25:07.574 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:07.584 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg2@snap 2023-12-06T04:25:08.642 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:08.654 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-12-06T04:25:08.733 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-12-06T04:25:08.801 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg2@snap 2023-12-06T04:25:08.847 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:08.856 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg4@snap 2023-12-06T04:25:09.642 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:09.652 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-12-06T04:25:09.750 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg4@snap 2023-12-06T04:25:09.807 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:09.815 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg1 2023-12-06T04:25:09.875 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg2 2023-12-06T04:25:10.133 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg3 2023-12-06T04:25:10.190 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg4 2023-12-06T04:25:10.248 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:10.248 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:10.248 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:10.273 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:10.274 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:10.274 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:10.401 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:10.402 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:10.402 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:10.402 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:10.428 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:10.428 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg6 2023-12-06T04:25:10.487 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:10.487 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:10.487 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 5 2023-12-06T04:25:10.513 INFO:tasks.workunit.client.0.smithi134.stdout:5 2023-12-06T04:25:10.513 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:10.513 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:11.860 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:11.860 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:11.860 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:11.861 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 3 2023-12-06T04:25:11.886 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:25:11.887 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:11.887 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg1 2023-12-06T04:25:11.912 INFO:tasks.workunit.client.0.smithi134.stdout:2503d2c91dc6 testimg1 2023-12-06T04:25:11.913 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:11.913 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg2 2023-12-06T04:25:11.938 INFO:tasks.workunit.client.0.smithi134.stdout:25093fc9733d testimg2 2023-12-06T04:25:11.939 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:11.939 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg3 2023-12-06T04:25:11.964 INFO:tasks.workunit.client.0.smithi134.stdout:250fa209c33 testimg3 2023-12-06T04:25:11.964 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg5 2023-12-06T04:25:12.224 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:12.224 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:12.224 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:12.250 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:12.250 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:12.250 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:13.791 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:13.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:13.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:13.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:25:13.817 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:25:13.817 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:13.817 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg3 2023-12-06T04:25:13.843 INFO:tasks.workunit.client.0.smithi134.stdout:250fa209c33 testimg3 2023-12-06T04:25:13.843 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd trash ls 2023-12-06T04:25:13.843 INFO:tasks.workunit.client.0.smithi134.stderr:++ awk '{ print $1 }' 2023-12-06T04:25:14.070 INFO:tasks.workunit.client.0.smithi134.stderr:+ ID=250fa209c33 2023-12-06T04:25:14.070 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap purge --image-id 250fa209c33 2023-12-06T04:25:14.653 INFO:tasks.workunit.client.0.smithi134.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T04:25:14.664 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:14.726 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:25:14.729 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:14.729 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:14.729 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:25:14.755 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:25:14.755 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T04:25:14.800 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg1@snap 2023-12-06T04:25:15.665 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:15.674 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-12-06T04:25:15.754 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg1@snap 2023-12-06T04:25:15.795 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:15.804 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T04:25:15.849 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg2@snap 2023-12-06T04:25:16.669 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:16.679 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-12-06T04:25:16.761 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-12-06T04:25:16.830 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg2@snap 2023-12-06T04:25:16.876 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:16.885 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg4@snap 2023-12-06T04:25:17.572 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:17.582 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-12-06T04:25:17.674 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg4@snap 2023-12-06T04:25:17.725 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:17.734 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-12-06T04:25:17.806 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:17.808 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-12-06T04:25:17.887 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:17.890 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg3 2023-12-06T04:25:17.966 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-12-06T04:25:18.045 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:18.048 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.048 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:18.048 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:18.074 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:18.074 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:18.075 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:18.283 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:18.284 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:18.284 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.284 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 3 2023-12-06T04:25:18.310 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:25:18.310 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.310 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg1 2023-12-06T04:25:18.335 INFO:tasks.workunit.client.0.smithi134.stdout:2570c15794ee testimg1 2023-12-06T04:25:18.336 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.336 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg2 2023-12-06T04:25:18.362 INFO:tasks.workunit.client.0.smithi134.stdout:257678b60da7 testimg2 2023-12-06T04:25:18.362 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.362 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg4 2023-12-06T04:25:18.387 INFO:tasks.workunit.client.0.smithi134.stdout:2582389e3eb9 testimg4 2023-12-06T04:25:18.388 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg6 2023-12-06T04:25:18.449 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.449 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:18.449 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:18.474 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:18.475 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:18.475 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:18.766 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:18.766 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.767 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:18.767 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 2 2023-12-06T04:25:18.792 INFO:tasks.workunit.client.0.smithi134.stdout:2 2023-12-06T04:25:18.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg1 2023-12-06T04:25:18.818 INFO:tasks.workunit.client.0.smithi134.stdout:2570c15794ee testimg1 2023-12-06T04:25:18.818 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.818 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg2 2023-12-06T04:25:18.844 INFO:tasks.workunit.client.0.smithi134.stdout:257678b60da7 testimg2 2023-12-06T04:25:18.844 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg5 2023-12-06T04:25:18.899 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:18.899 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:18.899 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 3 2023-12-06T04:25:18.924 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:25:18.924 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:19.012 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:19.011+0000 7f19614be700 0 -- 172.21.15.134:0/2843977433 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f194004f950 msgr2=0x7f1940051d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:19.027 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:19.026+0000 7f19614be700 0 -- 172.21.15.134:0/2843977433 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f19440367c0 msgr2=0x7f1944038bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:20.746 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:25:20.750 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:20.750 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:20.750 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:25:20.776 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:25:20.777 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-12-06T04:25:20.821 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg1@snap 2023-12-06T04:25:21.693 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:21.704 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-12-06T04:25:21.782 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg1@snap 2023-12-06T04:25:21.825 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:21.834 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-12-06T04:25:21.878 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg3@snap 2023-12-06T04:25:22.696 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:22.706 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg2@snap 2023-12-06T04:25:23.701 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:23.713 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-12-06T04:25:23.802 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-12-06T04:25:23.876 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg2@snap 2023-12-06T04:25:23.921 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:23.929 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg4@snap 2023-12-06T04:25:24.701 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:24.711 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-12-06T04:25:24.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm testimg4@snap 2023-12-06T04:25:24.842 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:24.849 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-12-06T04:25:24.934 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:24.936 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-12-06T04:25:25.007 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:25.009 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg3 2023-12-06T04:25:25.065 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-12-06T04:25:25.133 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:25.136 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:25.136 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:25.136 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:25.161 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:25.162 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:25.162 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:25.281 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:25.282 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:25.282 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:25.282 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:25.307 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:25.307 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg6 2023-12-06T04:25:25.381 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:25.381 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:25.381 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 5 2023-12-06T04:25:25.406 INFO:tasks.workunit.client.0.smithi134.stdout:5 2023-12-06T04:25:25.407 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:25.407 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:25.825 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:25.825 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:25.825 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:25.825 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 3 2023-12-06T04:25:25.851 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:25:25.851 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:25.851 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg1 2023-12-06T04:25:25.876 INFO:tasks.workunit.client.0.smithi134.stdout:25d082e90e17 testimg1 2023-12-06T04:25:25.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:25.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg2 2023-12-06T04:25:25.902 INFO:tasks.workunit.client.0.smithi134.stdout:25d61422ac29 testimg2 2023-12-06T04:25:25.903 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:25.903 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg3 2023-12-06T04:25:25.929 INFO:tasks.workunit.client.0.smithi134.stdout:25dc17c566de testimg3 2023-12-06T04:25:25.929 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash mv testimg5 2023-12-06T04:25:26.001 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:26.002 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:26.002 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 4 2023-12-06T04:25:26.027 INFO:tasks.workunit.client.0.smithi134.stdout:4 2023-12-06T04:25:26.027 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:26.027 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'some expired images could not be removed' 2023-12-06T04:25:27.667 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: some expired images could not be removed 2023-12-06T04:25:27.668 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:27.668 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:27.668 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:25:27.694 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:25:27.695 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:27.695 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep testimg3 2023-12-06T04:25:27.720 INFO:tasks.workunit.client.0.smithi134.stdout:25dc17c566de testimg3 2023-12-06T04:25:27.721 INFO:tasks.workunit.client.0.smithi134.stderr:++ rbd trash ls 2023-12-06T04:25:27.721 INFO:tasks.workunit.client.0.smithi134.stderr:++ awk '{ print $1 }' 2023-12-06T04:25:27.747 INFO:tasks.workunit.client.0.smithi134.stderr:+ ID=25dc17c566de 2023-12-06T04:25:27.747 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap purge --image-id 25dc17c566de 2023-12-06T04:25:28.710 INFO:tasks.workunit.client.0.smithi134.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T04:25:28.723 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash purge 2023-12-06T04:25:28.786 INFO:tasks.workunit.client.0.smithi134.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-12-06T04:25:28.789 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls 2023-12-06T04:25:28.789 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:28.789 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 0 2023-12-06T04:25:28.815 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:25:28.816 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_deep_copy_clone 2023-12-06T04:25:28.816 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing deep copy clone...' 2023-12-06T04:25:28.816 INFO:tasks.workunit.client.0.smithi134.stdout:testing deep copy clone... 2023-12-06T04:25:28.816 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:25:28.817 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:28.900 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:28.978 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.057 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.135 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.293 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.376 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.457 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.540 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.620 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.700 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.780 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.856 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:29.935 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:30.016 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:30.096 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:30.178 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:30.259 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create testimg1 --image-format 2 --size 256 2023-12-06T04:25:30.302 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg1 --snap=snap1 2023-12-06T04:25:30.724 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:30.734 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap protect testimg1@snap1 2023-12-06T04:25:30.775 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone testimg1@snap1 testimg2 2023-12-06T04:25:30.848 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg2@snap2 2023-12-06T04:25:31.728 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:31.738 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd deep copy testimg2 testimg3 2023-12-06T04:25:32.726 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:32.725+0000 7f78cef78700 0 -- 172.21.15.134:0/2959848410 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x55a870a9d220 msgr2=0x55a870a9f610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:32.747 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T04:25:32.751 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg3 2023-12-06T04:25:32.751 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:25:32.794 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:25:32.794 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg3 2023-12-06T04:25:32.794 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'parent: rbd/testimg1@snap1' 2023-12-06T04:25:32.835 INFO:tasks.workunit.client.0.smithi134.stdout: parent: rbd/testimg1@snap1 2023-12-06T04:25:32.835 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls testimg3 2023-12-06T04:25:32.835 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v SNAPID 2023-12-06T04:25:32.835 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:32.835 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:25:32.875 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:25:32.875 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls testimg3 2023-12-06T04:25:32.875 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '.*snap2.*' 2023-12-06T04:25:32.914 INFO:tasks.workunit.client.0.smithi134.stdout: 76 snap2 256 MiB Wed Dec 6 04:25:32 2023 2023-12-06T04:25:32.915 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg2 2023-12-06T04:25:32.915 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'features:.*deep-flatten' 2023-12-06T04:25:32.954 INFO:tasks.workunit.client.0.smithi134.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-12-06T04:25:32.954 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg3 2023-12-06T04:25:32.954 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'features:.*deep-flatten' 2023-12-06T04:25:32.993 INFO:tasks.workunit.client.0.smithi134.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-12-06T04:25:32.993 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd flatten testimg2 2023-12-06T04:25:33.044 INFO:tasks.workunit.client.0.smithi134.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-12-06T04:25:33.050 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd flatten testimg3 2023-12-06T04:25:33.098 INFO:tasks.workunit.client.0.smithi134.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-12-06T04:25:33.108 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap unprotect testimg1@snap1 2023-12-06T04:25:33.351 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap purge testimg2 2023-12-06T04:25:33.733 INFO:tasks.workunit.client.0.smithi134.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T04:25:33.741 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap purge testimg3 2023-12-06T04:25:34.736 INFO:tasks.workunit.client.0.smithi134.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-12-06T04:25:34.748 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm testimg2 2023-12-06T04:25:34.873 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2023-12-06T04:25:34.876 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm testimg3 2023-12-06T04:25:34.999 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2023-12-06T04:25:35.002 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap protect testimg1@snap1 2023-12-06T04:25:35.041 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone testimg1@snap1 testimg2 2023-12-06T04:25:35.109 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create testimg2@snap2 2023-12-06T04:25:35.743 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:35.753 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd deep copy --flatten testimg2 testimg3 2023-12-06T04:25:36.871 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 1% complete...2023-12-06T04:25:36.869+0000 7f3286a1b700 0 -- 172.21.15.134:0/1269937670 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x561cb4de3c70 msgr2=0x561cb4e3d0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:36.981 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete...2023-12-06T04:25:36.980+0000 7f3286a1b700 0 -- 172.21.15.134:0/1269937670 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f3268037150 msgr2=0x7f3268039540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:25:37.553 INFO:tasks.workunit.client.0.smithi134.stderr: Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-12-06T04:25:37.557 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg3 2023-12-06T04:25:37.557 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'size 256 MiB' 2023-12-06T04:25:37.591 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:25:37.592 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg3 2023-12-06T04:25:37.592 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v parent: 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout:rbd image 'testimg3': 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: size 256 MiB in 64 objects 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: order 22 (4 MiB objects) 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: snapshot_count: 1 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: id: 26ea82e58c8b 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: block_name_prefix: rbd_data.26ea82e58c8b 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: format: 2 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: op_features: 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: flags: 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: create_timestamp: Wed Dec 6 04:25:35 2023 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: access_timestamp: Wed Dec 6 04:25:35 2023 2023-12-06T04:25:37.624 INFO:tasks.workunit.client.0.smithi134.stdout: modify_timestamp: Wed Dec 6 04:25:35 2023 2023-12-06T04:25:37.625 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls testimg3 2023-12-06T04:25:37.625 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -v SNAPID 2023-12-06T04:25:37.625 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:37.625 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 1 2023-12-06T04:25:37.656 INFO:tasks.workunit.client.0.smithi134.stdout:1 2023-12-06T04:25:37.657 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap ls testimg3 2023-12-06T04:25:37.657 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '.*snap2.*' 2023-12-06T04:25:37.689 INFO:tasks.workunit.client.0.smithi134.stdout: 80 snap2 256 MiB Wed Dec 6 04:25:36 2023 2023-12-06T04:25:37.689 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd info testimg2 2023-12-06T04:25:37.689 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'features:.*deep-flatten' 2023-12-06T04:25:37.730 INFO:tasks.workunit.client.0.smithi134.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-12-06T04:25:37.730 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd flatten testimg2 2023-12-06T04:25:37.780 INFO:tasks.workunit.client.0.smithi134.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-12-06T04:25:37.788 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap unprotect testimg1@snap1 2023-12-06T04:25:37.830 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:25:37.830 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:38.882 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:39.883 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:40.978 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.057 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.135 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.214 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.294 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.372 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.454 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.533 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.621 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.699 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:41.981 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.062 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.144 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.223 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.306 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.385 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_clone_v2 2023-12-06T04:25:42.385 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing clone v2...' 2023-12-06T04:25:42.385 INFO:tasks.workunit.client.0.smithi134.stdout:testing clone v2... 2023-12-06T04:25:42.386 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:25:42.386 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.467 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.547 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.626 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.708 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.787 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.866 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:42.946 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.026 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.108 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.189 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.266 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.344 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.421 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.501 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.584 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.665 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:43.744 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:44.023 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T04:25:44.066 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@1 2023-12-06T04:25:44.572 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:44.581 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test2 2023-12-06T04:25:44.618 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:44.617+0000 7f13b1af9700 -1 librbd::image::CloneRequest: 0x5606065f29d0 validate_parent: parent snapshot must be protected 2023-12-06T04:25:44.619 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: clone error: (22) Invalid argument 2023-12-06T04:25:44.621 INFO:tasks.workunit.client.0.smithi134.stderr:+ true 2023-12-06T04:25:44.621 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test2 2023-12-06T04:25:44.687 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test3 2023-12-06T04:25:44.754 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap protect test1@1 2023-12-06T04:25:44.794 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test4 2023-12-06T04:25:44.859 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd children test1@1 2023-12-06T04:25:44.860 INFO:tasks.workunit.client.0.smithi134.stderr:+ sort 2023-12-06T04:25:44.860 INFO:tasks.workunit.client.0.smithi134.stderr:+ tr '\n' ' ' 2023-12-06T04:25:44.860 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -E 'test2.*test3.*test4' 2023-12-06T04:25:44.899 INFO:tasks.workunit.client.0.smithi134.stdout:rbd/test2 rbd/test3 rbd/test4 2023-12-06T04:25:44.900 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd children --descendants test1 2023-12-06T04:25:44.900 INFO:tasks.workunit.client.0.smithi134.stderr:+ sort 2023-12-06T04:25:44.900 INFO:tasks.workunit.client.0.smithi134.stderr:+ tr '\n' ' ' 2023-12-06T04:25:44.900 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -E 'test2.*test3.*test4' 2023-12-06T04:25:44.949 INFO:tasks.workunit.client.0.smithi134.stdout:rbd/test2 rbd/test3 rbd/test4 2023-12-06T04:25:44.949 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd remove test4 2023-12-06T04:25:45.059 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:45.058+0000 7f481f46d700 0 -- 172.21.15.134:0/3195144792 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f4804008780 msgr2=0x7f480400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:45.060 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:45.062 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap unprotect test1@1 2023-12-06T04:25:45.105 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap remove test1@1 2023-12-06T04:25:45.326 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:45.326+0000 7fa4960f3700 0 --2- 172.21.15.134:0/1950249632 >> v2:172.21.15.134:3300/0 conn(0x5571a5998df0 0x5571a5a2e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-12-06T04:25:45.346 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:45.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap list --all test1 2023-12-06T04:25:45.354 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep -E 'trash \(1\) *$' 2023-12-06T04:25:45.388 INFO:tasks.workunit.client.0.smithi134.stdout: 84 f6c75e8b-58af-46bb-9970-1f7c8829b39b 1 MiB Wed Dec 6 04:25:44 2023 trash (1) 2023-12-06T04:25:45.388 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@2 2023-12-06T04:25:45.576 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:45.585 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:25:45.585 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'image has snapshots' 2023-12-06T04:25:45.841 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: image has snapshots - these must be deleted with 'rbd snap purge' before the image can be removed. 2023-12-06T04:25:45.841 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm test1@2 2023-12-06T04:25:46.572 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:46.581 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:25:46.581 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'linked clones' 2023-12-06T04:25:46.644 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-12-06T04:25:46.644 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test3 2023-12-06T04:25:46.751 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:46.750+0000 7f492b2b2700 0 -- 172.21.15.134:0/131124629 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x5557dbe6cc80 msgr2=0x5557dbf120f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:46.759 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:46.762 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:25:46.762 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep 'linked clones' 2023-12-06T04:25:46.816 INFO:tasks.workunit.client.0.smithi134.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-12-06T04:25:46.816 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd flatten test2 2023-12-06T04:25:47.579 INFO:tasks.workunit.client.0.smithi134.stderr: Image flatten: 100% complete...done. 2023-12-06T04:25:47.598 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap list --all test1 2023-12-06T04:25:47.598 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:47.598 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:25:47.634 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:25:47.634 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:25:47.731 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:47.731+0000 7f9636534700 0 -- 172.21.15.134:0/3171977847 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f9610008780 msgr2=0x7f961000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:25:47.740 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:47.742 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:25:47.843 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:47.845 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 -s 1 test1 2023-12-06T04:25:47.889 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@1 2023-12-06T04:25:48.591 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:48.604 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap create test1@2 2023-12-06T04:25:49.590 INFO:tasks.workunit.client.0.smithi134.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-12-06T04:25:49.602 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone test1@1 test2 --rbd-default-clone-format 2 2023-12-06T04:25:49.685 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd clone test1@2 test3 --rbd-default-clone-format 2 2023-12-06T04:25:49.760 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm test1@1 2023-12-06T04:25:49.802 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:49.811 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd snap rm test1@2 2023-12-06T04:25:49.854 INFO:tasks.workunit.client.0.smithi134.stderr: Removing snap: 100% complete...done. 2023-12-06T04:25:49.864 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd rm test1 2023-12-06T04:25:49.864 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:25:49.912 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:49.912+0000 7f8fbf95d380 -1 librbd::api::Image: remove: image has snapshots - not removing 2023-12-06T04:25:49.913 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 0% complete...failed. 2023-12-06T04:25:49.918 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-12-06T04:25:49.921 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:25:49.921 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 --rbd-move-parent-to-trash-on-remove=true 2023-12-06T04:25:50.004 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:50.006 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls -a 2023-12-06T04:25:50.007 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:25:50.033 INFO:tasks.workunit.client.0.smithi134.stdout:281fb04d99ec test1 2023-12-06T04:25:50.034 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test2 2023-12-06T04:25:50.133 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:50.133+0000 7f48ce215700 0 -- 172.21.15.134:0/1029200037 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x55fce1bd6760 msgr2=0x55fce1beb450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:50.588 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:50.588+0000 7f48ce215700 0 -- 172.21.15.134:0/1029200037 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f48b00366b0 msgr2=0x7f48b0038ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:50.629 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:50.632 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls -a 2023-12-06T04:25:50.633 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:25:50.661 INFO:tasks.workunit.client.0.smithi134.stdout:281fb04d99ec test1 2023-12-06T04:25:50.661 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test3 2023-12-06T04:25:50.754 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:50.754+0000 7f346abc3700 0 -- 172.21.15.134:0/1185862604 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x558bb7005700 msgr2=0x558bb70b1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:51.589 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:25:51.589+0000 7f346abc3700 0 -- 172.21.15.134:0/1185862604 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7f344c0367d0 msgr2=0x7f344c038c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:51.651 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:51.655 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd trash ls -a 2023-12-06T04:25:51.655 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail grep test1 2023-12-06T04:25:51.655 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:25:51.683 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:25:51.683 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_thick_provision 2023-12-06T04:25:51.683 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing thick provision...' 2023-12-06T04:25:51.684 INFO:tasks.workunit.client.0.smithi134.stdout:testing thick provision... 2023-12-06T04:25:51.684 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:25:51.684 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:51.766 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:51.847 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:51.928 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.011 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.091 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.169 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.251 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.331 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.410 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.490 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.572 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.652 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.731 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.811 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:52.892 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:53.174 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:53.254 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:25:53.336 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --thick-provision -s 64M test1 2023-12-06T04:25:53.647 INFO:tasks.workunit.client.0.smithi134.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-12-06T04:25:53.657 INFO:tasks.workunit.client.0.smithi134.stderr:+ count=0 2023-12-06T04:25:53.657 INFO:tasks.workunit.client.0.smithi134.stderr:+ ret= 2023-12-06T04:25:53.658 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 -lt 10 ']' 2023-12-06T04:25:53.658 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd du 2023-12-06T04:25:53.658 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:25:53.658 INFO:tasks.workunit.client.0.smithi134.stderr:+ tr -s ' ' 2023-12-06T04:25:53.658 INFO:tasks.workunit.client.0.smithi134.stderr:+ cut -d ' ' -f 4-5 2023-12-06T04:25:53.658 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^64 MiB' 2023-12-06T04:25:53.689 INFO:tasks.workunit.client.0.smithi134.stdout:64 MiB 2023-12-06T04:25:53.690 INFO:tasks.workunit.client.0.smithi134.stderr:+ ret=0 2023-12-06T04:25:53.690 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 = 0 ']' 2023-12-06T04:25:53.690 INFO:tasks.workunit.client.0.smithi134.stderr:+ break 2023-12-06T04:25:53.690 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd du 2023-12-06T04:25:53.718 INFO:tasks.workunit.client.0.smithi134.stdout:NAME PROVISIONED USED 2023-12-06T04:25:53.719 INFO:tasks.workunit.client.0.smithi134.stdout:test1 64 MiB 64 MiB 2023-12-06T04:25:53.721 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 '!=' 0 ']' 2023-12-06T04:25:53.721 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:25:53.846 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete...2023-12-06T04:25:53.846+0000 7febba78f700 0 -- 172.21.15.134:0/2463927023 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x55919d1454e0 msgr2=0x55919d1e8f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:53.874 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 100% complete...done. 2023-12-06T04:25:53.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:25:53.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:25:53.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:25:53.877 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:25:53.903 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:25:53.903 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --thick-provision -s 4G test1 2023-12-06T04:25:54.436 INFO:tasks.workunit.client.0.smithi134.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete...2023-12-06T04:25:54.436+0000 7f19b7751700 0 -- 172.21.15.134:0/3918911039 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x560b8dac8a20 msgr2=0x560b8dad85c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:25:54.567 INFO:tasks.workunit.client.0.smithi134.stderr: Thick provisioning: 6% complete...2023-12-06T04:25:54.567+0000 7f19b7751700 0 -- 172.21.15.134:0/3918911039 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7f19980367d0 msgr2=0x7f1998038c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:26:04.204 INFO:tasks.workunit.client.0.smithi134.stderr: Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete... Thick provisioning: 12% complete... Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-12-06T04:26:04.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ count=0 2023-12-06T04:26:04.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ ret= 2023-12-06T04:26:04.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 -lt 10 ']' 2023-12-06T04:26:04.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd du 2023-12-06T04:26:04.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:26:04.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ tr -s ' ' 2023-12-06T04:26:04.215 INFO:tasks.workunit.client.0.smithi134.stderr:+ cut -d ' ' -f 4-5 2023-12-06T04:26:04.216 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^4 GiB' 2023-12-06T04:26:04.249 INFO:tasks.workunit.client.0.smithi134.stdout:4 GiB 2023-12-06T04:26:04.250 INFO:tasks.workunit.client.0.smithi134.stderr:+ ret=0 2023-12-06T04:26:04.250 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 = 0 ']' 2023-12-06T04:26:04.250 INFO:tasks.workunit.client.0.smithi134.stderr:+ break 2023-12-06T04:26:04.250 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd du 2023-12-06T04:26:04.279 INFO:tasks.workunit.client.0.smithi134.stdout:NAME PROVISIONED USED 2023-12-06T04:26:04.280 INFO:tasks.workunit.client.0.smithi134.stdout:test1 4 GiB 4 GiB 2023-12-06T04:26:04.282 INFO:tasks.workunit.client.0.smithi134.stderr:+ '[' 0 '!=' 0 ']' 2023-12-06T04:26:04.282 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd rm test1 2023-12-06T04:26:04.389 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 1% complete...2023-12-06T04:26:04.387+0000 7fc519bc0700 0 -- 172.21.15.134:0/1074332416 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x7fc4f40061b0 msgr2=0x7fc4f40085a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:26:04.413 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 2% complete... Removing image: 3% complete...2023-12-06T04:26:04.409+0000 7fc519bc0700 0 -- 172.21.15.134:0/1074332416 >> [v2:172.21.15.134:6800/114486,v1:172.21.15.134:6801/114486] conn(0x55e2527c1600 msgr2=0x7fc4fc039150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-12-06T04:26:05.367 INFO:tasks.workunit.client.0.smithi134.stderr: Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-12-06T04:26:05.370 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd ls 2023-12-06T04:26:05.370 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test1 2023-12-06T04:26:05.370 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:26:05.371 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:26:05.397 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:26:05.397 INFO:tasks.workunit.client.0.smithi134.stderr:+ test_namespace 2023-12-06T04:26:05.397 INFO:tasks.workunit.client.0.smithi134.stderr:+ echo 'testing namespace...' 2023-12-06T04:26:05.398 INFO:tasks.workunit.client.0.smithi134.stdout:testing namespace... 2023-12-06T04:26:05.398 INFO:tasks.workunit.client.0.smithi134.stderr:+ remove_images 2023-12-06T04:26:05.398 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:05.474 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:05.554 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:05.633 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:05.712 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:05.792 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:05.871 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:05.950 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.029 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.110 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.190 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.270 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.349 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.429 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.709 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.788 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.870 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:06.952 INFO:tasks.workunit.client.0.smithi134.stderr:+ for img in $IMGS 2023-12-06T04:26:07.033 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd namespace ls 2023-12-06T04:26:07.034 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:26:07.034 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^0$' 2023-12-06T04:26:07.260 INFO:tasks.workunit.client.0.smithi134.stdout:0 2023-12-06T04:26:07.261 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd namespace create rbd/test1 2023-12-06T04:26:07.294 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd namespace create --pool rbd --namespace test2 2023-12-06T04:26:07.328 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd namespace create --namespace test3 2023-12-06T04:26:07.361 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd namespace create rbd/test3 2023-12-06T04:26:07.361 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd namespace create rbd/test3 2023-12-06T04:26:07.390 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: failed to created namespace: (17) File exists 2023-12-06T04:26:07.390 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:26:07.388+0000 7fb175209380 -1 librbd::api::Namespace: create: failed to add namespace: (17) File exists 2023-12-06T04:26:07.392 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:26:07.392 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd namespace list 2023-12-06T04:26:07.393 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep test 2023-12-06T04:26:07.393 INFO:tasks.workunit.client.0.smithi134.stderr:+ wc -l 2023-12-06T04:26:07.393 INFO:tasks.workunit.client.0.smithi134.stderr:+ grep '^3$' 2023-12-06T04:26:07.418 INFO:tasks.workunit.client.0.smithi134.stdout:3 2023-12-06T04:26:07.419 INFO:tasks.workunit.client.0.smithi134.stderr:+ expect_fail rbd namespace remove --pool rbd missing 2023-12-06T04:26:07.419 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd namespace remove --pool rbd missing 2023-12-06T04:26:07.439 INFO:tasks.workunit.client.0.smithi134.stderr:rbd: namespace name was not specified 2023-12-06T04:26:07.440 INFO:tasks.workunit.client.0.smithi134.stderr:+ return 0 2023-12-06T04:26:07.440 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd create --image-format 2 --size 1G rbd/test1/image1 2023-12-06T04:26:07.491 INFO:tasks.workunit.client.0.smithi134.stderr:+ rbd bench --io-type write --io-pattern rand --io-total 32M --io-size 4K rbd/test1/image1 2023-12-06T04:26:07.552 INFO:tasks.workunit.client.0.smithi134.stdout:bench type write io_size 4096 io_threads 16 bytes 33554432 pattern random 2023-12-06T04:26:38.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:38.061+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.10581.0:1026 3.2 3:5d7c7cde:test1::rbd_data.295227fc2d39.000000000000000a:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4001792~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:38.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:38.774+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:39.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:39.111+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:39.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:39.736+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:40.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:40.131+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:40.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:40.692+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:41.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:41.103+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:41.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:41.714+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:42.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:42.100+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:42.740 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:42.740+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:43.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:43.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:43.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:43.753+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:44.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:44.184+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:44.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:44.799+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:45.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:45.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:45.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:45.791+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:46.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:46.206+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:46.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:46.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:47.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:47.174+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:47.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:47.763+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:48.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:48.142+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:48.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:48.805+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:49.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:49.189+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:49.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:49.766+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:50.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:50.177+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:50.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:50.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:51.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:51.147+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:51.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:51.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:52.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:52.177+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:52.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:52.707+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:53.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:53.183+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:53.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:53.707+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:54.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:54.182+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:54.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:54.748+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:55.226 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:55.225+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:55.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:55.745+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:56.226 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:56.221+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:56.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:56.785+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:57.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:57.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:57.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:57.817+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:58.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:58.250+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:58.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:58.804+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:59.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:26:59.248+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:26:59.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:26:59.802+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:00.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:00.239+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:00.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:00.845+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:01.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:01.283+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:01.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:01.873+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:02.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:02.325+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:02.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:02.862+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:03.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:03.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:03.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:03.894+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:04.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:04.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:04.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:04.915+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:05.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:05.319+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:05.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:05.927+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:06.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:06.323+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:06.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:06.949+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:07.352 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:07.351+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:07.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:07.933+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:08.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:08.323+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:08.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:08.920+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:09.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:09.301+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:09.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:09.892+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:10.332 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:10.331+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:10.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:10.880+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:11.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:11.375+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:11.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:11.905+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:12.415 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:12.414+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:12.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:12.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:13.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:13.436+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:13.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:13.884+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:14.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:14.421+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:14.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:14.897+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:15.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:15.455+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:15.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:15.940+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:16.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:16.432+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:16.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:16.981+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:17.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:17.425+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:18.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:18.015+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:18.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:18.439+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:18.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:18.966+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:19.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:19.405+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:19.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:19.943+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:20.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:20.452+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:20.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:20.896+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:21.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:21.443+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:21.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:21.879+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:22.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:22.461+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:22.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:22.882+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:23.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:23.445+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:23.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:23.901+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:24.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:24.438+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:24.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:24.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:25.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:25.481+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:25.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:25.866+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:26.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:26.525+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:26.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:26.855+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:27.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:27.566+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:27.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:27.886+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:28.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:28.559+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:28.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:28.909+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:29.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:29.581+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:29.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:29.914+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:30.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:30.556+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:30.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:30.869+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:31.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:31.539+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:31.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:31.892+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:32.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:32.583+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:32.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:32.878+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:33.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:33.538+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:33.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:33.901+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:34.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:34.513+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:34.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:34.858+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:35.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:35.505+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:35.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:35.866+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:36.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:36.468+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:36.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:36.888+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:37.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:37.446+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:37.863 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:37.862+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:38.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:38.409+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:38.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:38.841+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:39.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:39.430+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:39.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:39.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:40.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:40.473+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:40.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:40.818+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:41.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:41.517+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:41.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:41.787+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:42.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:42.480+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:42.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:42.753+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:43.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:43.514+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:43.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:43.710+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:44.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:44.470+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:44.688 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:44.686+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:45.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:45.433+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:45.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:45.666+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:46.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:46.409+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:46.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:46.634+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:47.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:47.388+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:47.648 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:47.646+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:48.409 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:48.407+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:48.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:48.610+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:49.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:49.382+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:49.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:49.602+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:50.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:50.367+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:50.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:50.559+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:51.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:51.392+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:51.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:51.578+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:52.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:52.439+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:52.547 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:52.546+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:53.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:53.436+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:53.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:53.586+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:54.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:54.471+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:54.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:54.608+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:55.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:55.514+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:55.621 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:55.620+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:56.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:56.492+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:56.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:56.573+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:57.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:57.534+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:57.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:57.612+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:58.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:58.514+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:58.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:58.625+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:59.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:27:59.542+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:27:59.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:27:59.647+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:00.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:00.586+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:00.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:00.698+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:01.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:01.585+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:01.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:01.692+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:02.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:02.594+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:02.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:02.677+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:03.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:03.555+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:03.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:03.702+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:04.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:04.506+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:04.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:04.744+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:05.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:05.471+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:05.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:05.780+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:06.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:06.442+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:06.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:06.797+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:07.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:07.424+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:07.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:07.808+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:08.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:08.399+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:08.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:08.846+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:09.415 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:09.414+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:09.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:09.846+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:10.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:10.423+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:10.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:10.804+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:11.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:11.386+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:11.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:11.844+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:12.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:12.342+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:12.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:12.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:13.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:13.353+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:13.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:13.817+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:14.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:14.308+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:14.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:14.855+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:15.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:15.271+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:15.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:15.871+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:16.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:16.309+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:16.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:16.899+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:17.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:17.287+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:17.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:17.854+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:18.332 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:18.330+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:18.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:18.866+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:19.352 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:19.350+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:19.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:19.843+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:20.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:20.333+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:20.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:20.855+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:21.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:21.296+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:21.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:21.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:22.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:22.317+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:22.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:22.908+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:23.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:23.274+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:23.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:23.934+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:24.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:24.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:24.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:24.947+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:25.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:25.327+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:25.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:25.940+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:26.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:26.280+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:26.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:26.918+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:27.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:27.237+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:27.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:27.953+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:28.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:28.236+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:28.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:28.920+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:29.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:29.265+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:29.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:29.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:30.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:30.302+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:30.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:30.893+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:31.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:31.255+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:31.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:31.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:32.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:32.237+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:32.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:32.856+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:33.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:33.247+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:33.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:33.837+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:34.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:34.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:34.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:34.858+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:35.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:35.307+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:35.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:35.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:36.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:36.313+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:36.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:36.863+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:37.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:37.315+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:37.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:37.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:38.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:38.267+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:38.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:38.895+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:39.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:39.309+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:39.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:39.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:40.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:40.359+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:40.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:40.939+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:41.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:41.371+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:41.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:41.921+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:42.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:42.353+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:42.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:42.906+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:43.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:43.374+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:43.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:43.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:44.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:44.338+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:44.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:44.954+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:45.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:45.340+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:45.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:45.960+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:46.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:46.358+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:46.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:46.984+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:47.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:47.348+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:47.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:47.984+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:48.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:48.326+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:48.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:48.948+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:49.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:49.342+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:49.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:49.973+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:50.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:50.311+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:51.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:51.015+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:51.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:51.317+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:52.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:52.027+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:52.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:52.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:53.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:53.045+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:53.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:53.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:54.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:54.042+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:54.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:54.262+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:55.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:55.035+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:55.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:55.299+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:56.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:56.056+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:56.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:56.349+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:57.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:57.016+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:57.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:57.305+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:58.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:58.050+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:58.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:58.273+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:59.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:28:59.059+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:28:59.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:28:59.294+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:00.040 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:00.039+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:00.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:00.311+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:01.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:01.007+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:01.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:01.352+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:02.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:02.033+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:02.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:02.341+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:02.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:02.993+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:03.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:03.336+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:03.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:03.977+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:04.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:04.325+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:04.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:04.998+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:05.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:05.367+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:05.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:05.963+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:06.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:06.401+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:07.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:07.005+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:07.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:07.375+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:07.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:07.971+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:08.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:08.374+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:08.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:08.936+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:09.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:09.369+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:09.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:09.930+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:10.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:10.414+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:10.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:10.957+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:11.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:11.433+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:11.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:11.945+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:12.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:12.456+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:12.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:12.952+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:13.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:13.483+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:13.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:13.987+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:14.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:14.509+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:15.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:15.011+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:15.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:15.479+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:15.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:15.967+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:16.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:16.499+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:16.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:16.933+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:17.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:17.535+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:17.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:17.975+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:18.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:18.521+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:18.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:18.963+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:19.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:19.549+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:20.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:20.013+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:20.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:20.546+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:21.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:21.038+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:21.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:21.499+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:22.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:22.087+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:22.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:22.521+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:23.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:23.135+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:23.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:23.495+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:24.171 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:24.170+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:24.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:24.471+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:25.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:25.213+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:25.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:25.485+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:26.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:26.234+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:26.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:26.462+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:27.245 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:27.244+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:27.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:27.454+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:28.276 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:28.275+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:28.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:28.492+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:29.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:29.226+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:29.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:29.463+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:30.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:30.194+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:30.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:30.494+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:31.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:31.166+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:31.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:31.532+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:32.145 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:32.144+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:32.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:32.524+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:33.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:33.168+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:33.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:33.571+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:34.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:34.164+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:34.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:34.597+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:35.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:35.195+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:35.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:35.574+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:36.202 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:36.202+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:36.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:36.533+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:37.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:37.155+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:37.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:37.507+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:38.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:38.130+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:38.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:38.487+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:39.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:39.115+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:39.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:39.471+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:40.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:40.109+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:40.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:40.514+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:41.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:41.151+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:41.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:41.563+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:42.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:42.196+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:42.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:42.539+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:43.233 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:43.231+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:43.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:43.499+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:44.239 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:44.237+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:44.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:44.542+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:45.285 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:45.283+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:45.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:45.513+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:46.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:46.247+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:46.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:46.534+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:47.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:47.225+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:47.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:47.551+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:48.220 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:48.219+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:48.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:48.536+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:49.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:49.257+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:49.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:49.573+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:50.285 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:50.284+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:50.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:50.561+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:51.264 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:51.263+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:51.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:51.552+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:52.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:52.251+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:52.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:52.518+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:53.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:53.242+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:53.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:53.557+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:54.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:54.226+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:54.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:54.587+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:55.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:55.217+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:55.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:55.564+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:56.253 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:56.251+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:56.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:56.550+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:57.297 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:57.295+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:57.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:57.509+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:58.276 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:58.275+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:58.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:58.553+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:59.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:29:59.288+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:29:59.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:29:59.577+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:00.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:00.298+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:00.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:00.533+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:01.281 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:01.280+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:01.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:01.511+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:02.330 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:02.329+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:02.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:02.501+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:03.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:03.339+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:03.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:03.515+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:04.295 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:04.293+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:04.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:04.548+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:05.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:05.325+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:05.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:05.513+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:06.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:06.287+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:06.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:06.491+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:07.325 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:07.323+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:07.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:07.491+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:08.285 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:08.283+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:08.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:08.529+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:09.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:09.283+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:09.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:09.507+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:10.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:10.263+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:10.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:10.538+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:11.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:11.227+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:11.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:11.548+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:12.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:12.205+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:12.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:12.598+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:13.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:13.160+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:13.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:13.602+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:14.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:14.112+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:14.627 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:14.627+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:15.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:15.127+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:15.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:15.675+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:16.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:16.155+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:16.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:16.658+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:17.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:17.125+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:17.639 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:17.638+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:18.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:18.117+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:18.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:18.591+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:19.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:19.141+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:19.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:19.577+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:20.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:20.139+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:20.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:20.540+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:21.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:21.107+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:21.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:21.586+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:22.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:22.111+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:22.628 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:22.627+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:23.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:23.098+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:23.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:23.578+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:24.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:24.066+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:24.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:24.552+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:25.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:25.038+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:25.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:25.530+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:25.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:25.995+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:26.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:26.534+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:27.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:27.007+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:27.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:27.576+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:28.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:28.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:28.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:28.579+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:29.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:29.042+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:29.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:29.586+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:30.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:30.029+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:30.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:30.578+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:31.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:31.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:31.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:31.568+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:32.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:32.016+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:32.561 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:32.560+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:33.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:33.036+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:33.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:33.550+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:34.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:34.083+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:34.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:34.545+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:35.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:35.036+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:35.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:35.536+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:36.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:36.042+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:36.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:36.557+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:37.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:37.090+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:37.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:37.590+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:38.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:38.126+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:38.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:38.562+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:39.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:39.138+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:39.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:39.536+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:40.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:40.095+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:40.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:40.492+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:41.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:41.108+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:41.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:41.460+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:42.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:42.096+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:42.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:42.459+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:43.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:43.107+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:43.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:43.443+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:44.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:44.080+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:44.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:44.430+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:45.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:45.064+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:45.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:45.416+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:46.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:46.101+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:46.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:46.417+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:47.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:47.112+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:47.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:47.406+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:48.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:48.112+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:48.409 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:48.408+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:49.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:49.066+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:49.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:49.370+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:50.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:50.116+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:50.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:50.372+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:51.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:51.086+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:51.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:51.352+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:52.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:52.087+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:52.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:52.330+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:53.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:53.097+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:53.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:53.346+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:54.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:54.114+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:54.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:54.334+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:55.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:55.115+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:55.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:55.315+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:56.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:56.100+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:56.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:56.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:57.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:57.136+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:57.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:57.380+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:58.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:58.165+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:58.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:58.413+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:59.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:30:59.165+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:30:59.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:30:59.411+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:00.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:00.173+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:00.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:00.447+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:01.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:01.184+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:01.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:01.478+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:02.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:02.150+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:02.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:02.462+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:03.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:03.181+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:03.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:03.447+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:04.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:04.139+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:04.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:04.431+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:05.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:05.156+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:05.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:05.462+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:06.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:06.119+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:06.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:06.470+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:07.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:07.077+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:07.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:07.434+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:08.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:08.106+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:08.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:08.463+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:09.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:09.118+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:09.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:09.510+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:10.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:10.075+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:10.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:10.470+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:11.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:11.098+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:11.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:11.452+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:12.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:12.130+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:12.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:12.488+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:13.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:13.107+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:13.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:13.488+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:14.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:14.099+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:14.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:14.494+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:15.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:15.059+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:15.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:15.451+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:16.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:16.023+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:16.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:16.478+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:17.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:17.048+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:17.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:17.502+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:18.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:18.049+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:18.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:18.484+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:19.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:19.048+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:19.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:19.515+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:20.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:20.062+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:20.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:20.564+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:21.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:21.082+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:21.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:21.518+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:22.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:22.088+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:22.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:22.558+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:23.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:23.105+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:23.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:23.525+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:24.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:24.120+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:24.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:24.483+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:25.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:25.145+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:25.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:25.491+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:26.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:26.098+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:26.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:26.488+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:27.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:27.066+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:27.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:27.455+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:28.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:28.020+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:28.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:28.477+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:29.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:29.014+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:29.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:29.520+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:29.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:29.970+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:30.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:30.499+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:30.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:30.937+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:31.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:31.470+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:31.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:31.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:32.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:32.506+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:32.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:32.907+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:33.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:33.484+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:33.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:33.885+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:34.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:34.507+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:34.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:34.923+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:35.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:35.536+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:35.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:35.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:36.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:36.565+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:36.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:36.884+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:37.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:37.526+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:37.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:37.871+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:38.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:38.512+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:38.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:38.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:39.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:39.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:39.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:39.886+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:40.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:40.456+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:40.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:40.908+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:41.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:41.409+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:41.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:41.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:42.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:42.452+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:42.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:42.942+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:43.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:43.446+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:43.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:43.893+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:44.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:44.492+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:44.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:44.907+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:45.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:45.494+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:45.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:45.943+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:46.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:46.477+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:46.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:46.902+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:47.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:47.468+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:47.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:47.936+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:48.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:48.474+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:48.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:48.980+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:49.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:49.429+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:49.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:49.949+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:50.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:50.471+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:50.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:50.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:51.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:51.502+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:51.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:51.946+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:52.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:52.511+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:52.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:52.993+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:53.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:53.474+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:53.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:53.951+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:54.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:54.427+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:54.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:54.923+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:55.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:55.409+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:55.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:55.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:56.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:56.425+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:56.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:56.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:57.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:57.425+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:57.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:57.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:58.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:58.413+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:58.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:58.941+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:59.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:31:59.451+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:31:59.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:31:59.973+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:00.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:00.481+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:00.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:00.931+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:01.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:01.477+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:01.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:01.911+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:02.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:02.439+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:02.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:02.945+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:03.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:03.477+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:03.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:03.996+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:04.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:04.432+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:05.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:05.037+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:05.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:05.405+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:06.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:06.047+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:06.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:06.455+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:07.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:07.026+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:07.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:07.407+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:08.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:08.021+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:08.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:08.417+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:09.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:09.065+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:09.415 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:09.414+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:10.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:10.091+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:10.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:10.399+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:11.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:11.055+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:11.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:11.435+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:12.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:12.016+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:12.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:12.402+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:13.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:13.029+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:13.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:13.366+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:14.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:14.047+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:14.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:14.347+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:15.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:15.054+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:15.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:15.337+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:16.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:16.075+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:16.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:16.337+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:17.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:17.111+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:17.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:17.291+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:18.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:18.093+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:18.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:18.265+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:19.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:19.131+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:19.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:19.232+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:20.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:20.096+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:20.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:20.215+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:21.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:21.096+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:21.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:21.203+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:22.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:22.141+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:22.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:22.235+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:23.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:23.111+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:23.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:23.285+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:24.138 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:24.138+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:24.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:24.297+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:25.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:25.159+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:25.337 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:25.334+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:26.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:26.163+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:26.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:26.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:27.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:27.132+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:27.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:27.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:28.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:28.092+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:28.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:28.329+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:29.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:29.080+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:29.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:29.297+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:30.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:30.073+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:30.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:30.264+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:31.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:31.061+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:31.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:31.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:32.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:32.097+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:32.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:32.326+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:33.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:33.047+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:33.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:33.350+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:34.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:34.064+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:34.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:34.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:35.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:35.066+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:35.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:35.273+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:36.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:36.054+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:36.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:36.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:37.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:37.046+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:37.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:37.210+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:38.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:38.060+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:38.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:38.214+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:39.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:39.086+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:39.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:39.248+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:40.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:40.110+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:40.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:40.228+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:41.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:41.112+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:41.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:41.228+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:42.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:42.143+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:42.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:42.214+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:43.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:43.136+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:43.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:43.220+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:44.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:44.181+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:44.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:44.205+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:45.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:45.160+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:45.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:45.165+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:46.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:46.123+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:46.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:46.130+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:47.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:47.109+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:47.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:47.146+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:48.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:48.114+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:48.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:48.184+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:49.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:49.079+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:49.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:49.166+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:50.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:50.078+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:50.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:50.134+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:51.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:51.074+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:51.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:51.166+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:52.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:52.030+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:52.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:52.211+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:52.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:52.988+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:53.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:53.213+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:54.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:54.008+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:54.202 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:54.201+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:54.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:54.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:55.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:55.228+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:55.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:55.949+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:56.191 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:56.190+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:56.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:56.921+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:57.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:57.143+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:57.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:57.942+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:58.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:58.148+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:58.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:58.990+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:32:59.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:32:59.104+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:00.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:32:59.999+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:00.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:00.121+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:01.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:01.015+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:01.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:01.101+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:02.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:02.042+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:02.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:02.079+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:03.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:03.070+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:03.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:03.114+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:04.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:04.044+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:04.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:04.081+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:05.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:05.065+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:05.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:05.101+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:06.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:06.060+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:06.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:06.127+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:07.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:07.029+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:07.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:07.106+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:08.041 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:08.040+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:08.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:08.086+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:09.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:09.005+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:09.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:09.135+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:10.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:10.018+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:10.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:10.149+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:11.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:11.024+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:11.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:11.159+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:12.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:12.033+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:12.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:12.158+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:13.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:13.006+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:13.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:13.168+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:14.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:14.018+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:14.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:14.143+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:14.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:14.979+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:15.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:15.100+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:15.986 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:15.986+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:16.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:16.066+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:17.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:16.998+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:17.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:17.099+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:17.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:17.961+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:18.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:18.053+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:18.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:18.951+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:19.077 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:19.075+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:19.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:19.979+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:20.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:20.087+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:20.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:20.942+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:21.053 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:21.051+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:21.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:21.973+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:22.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:22.099+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:23.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:23.023+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:23.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:23.090+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:24.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:24.061+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:24.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:24.093+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:25.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:25.021+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:25.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:25.071+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:25.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:25.995+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:26.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:26.071+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:26.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:26.955+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:27.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:27.121+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:28.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:28.004+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:28.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:28.105+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:28.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:28.964+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:29.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:29.094+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:29.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:29.942+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:30.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:30.064+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:30.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:30.951+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:31.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:31.052+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:31.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:31.948+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:32.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:32.070+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:32.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:32.982+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:33.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:33.112+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:33.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:33.979+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:34.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:34.123+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:34.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:34.960+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:35.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:35.124+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:35.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:35.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:36.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:36.117+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:37.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:37.008+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:37.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:37.096+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:38.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:38.051+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:38.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:38.077+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:39.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:39.003+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:39.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:39.065+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:39.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:39.983+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:40.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:40.066+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:40.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:40.959+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:41.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:41.047+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:41.986 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:41.985+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:42.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:42.089+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:42.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:42.953+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:43.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:43.041+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:43.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:43.939+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:44.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:44.029+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:44.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:44.892+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:45.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:45.045+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:45.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:45.921+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:46.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:46.000+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:46.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:46.932+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:47.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:47.006+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:47.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:47.938+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:47.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:47.988+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:48.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:48.942+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:48.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:48.966+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:49.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:49.934+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:49.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:49.986+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:50.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:50.906+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:50.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:50.972+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:51.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:51.886+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:51.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:51.993+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:52.920 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:52.920+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:53.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:53.007+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:53.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:53.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:53.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:53.987+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:54.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:54.889+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:55.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:55.032+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:55.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:55.851+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:56.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:56.078+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:56.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:56.844+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:57.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:57.098+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:57.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:57.880+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:58.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:58.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:58.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:58.922+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:59.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:33:59.102+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:33:59.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:33:59.905+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:00.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:00.113+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:00.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:00.857+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:01.066 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:01.065+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:01.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:01.835+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:02.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:02.061+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:02.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:02.879+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:03.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:03.083+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:03.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:03.859+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:04.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:04.047+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:04.866 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:04.864+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:05.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:05.075+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:05.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:05.846+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:06.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:06.050+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:06.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:06.885+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:07.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:07.087+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:07.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:07.921+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:08.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:08.061+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:08.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:08.951+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:09.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:09.063+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:09.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:09.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:10.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:10.015+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:10.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:10.875+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:10.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:10.967+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:11.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:11.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:12.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:12.003+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:12.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:12.875+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:13.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:13.020+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:13.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:13.867+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:13.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:13.990+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:14.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:14.873+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:15.029 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:15.027+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:15.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:15.840+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:16.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:16.069+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:16.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:16.821+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:17.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:17.097+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:17.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:17.815+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:18.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:18.089+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:18.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:18.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:19.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:19.136+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:19.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:19.830+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:20.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:20.131+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:20.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:20.820+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:21.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:21.116+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:21.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:21.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:22.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:22.082+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:22.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:22.823+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:23.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:23.130+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:23.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:23.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:24.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:24.161+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:24.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:24.837+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:25.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:25.195+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:25.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:25.869+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:26.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:26.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:26.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:26.849+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:27.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:27.220+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:27.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:27.806+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:28.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:28.254+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:28.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:28.831+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:29.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:29.302+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:29.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:29.799+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:30.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:30.343+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:30.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:30.805+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:31.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:31.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:31.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:31.770+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:32.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:32.324+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:32.799 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:32.798+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:33.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:33.326+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:33.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:33.764+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:34.291 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:34.290+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:34.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:34.792+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:35.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:35.251+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:35.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:35.827+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:36.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:36.293+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:36.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:36.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:37.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:37.285+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:37.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:37.847+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:38.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:38.248+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:38.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:38.831+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:39.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:39.273+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:39.813 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:39.812+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:40.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:40.250+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:40.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:40.765+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:41.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:41.255+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:41.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:41.745+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:42.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:42.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:42.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:42.749+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:43.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:43.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:43.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:43.716+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:44.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:44.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:44.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:44.723+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:45.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:45.196+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:45.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:45.720+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:46.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:46.246+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:46.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:46.685+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:47.259 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:47.258+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:47.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:47.675+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:48.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:48.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:48.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:48.627+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:49.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:49.241+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:49.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:49.590+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:50.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:50.233+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:50.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:50.541+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:51.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:51.227+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:51.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:51.569+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:52.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:52.276+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:52.609 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:52.608+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:53.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:53.310+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:53.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:53.602+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:54.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:54.342+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:54.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:54.633+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:55.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:55.316+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:55.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:55.678+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:56.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:56.343+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:56.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:56.686+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:57.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:57.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:57.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:57.642+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:58.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:58.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:58.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:58.684+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:59.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:34:59.232+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:34:59.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:34:59.729+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:00.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:00.268+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:00.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:00.717+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:01.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:01.276+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:01.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:01.768+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:02.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:02.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:02.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:02.729+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:03.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:03.282+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:03.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:03.720+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:04.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:04.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:04.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:04.748+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:05.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:05.348+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:05.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:05.794+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:06.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:06.381+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:06.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:06.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:07.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:07.348+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:07.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:07.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:08.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:08.328+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:08.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:08.835+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:09.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:09.316+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:09.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:09.845+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:10.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:10.354+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:10.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:10.822+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:11.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:11.318+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:11.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:11.821+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:12.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:12.330+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:12.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:12.823+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:13.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:13.375+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:13.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:13.774+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:14.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:14.419+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:14.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:14.823+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:15.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:15.410+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:15.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:15.807+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:16.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:16.455+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:16.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:16.834+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:17.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:17.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:17.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:17.815+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:18.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:18.449+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:18.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:18.805+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:19.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:19.406+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:19.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:19.773+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:20.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:20.413+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:20.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:20.747+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:21.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:21.432+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:21.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:21.762+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:22.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:22.475+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:22.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:22.729+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:23.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:23.439+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:23.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:23.737+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:24.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:24.417+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:24.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:24.773+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:25.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:25.439+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:25.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:25.796+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:26.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:26.447+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:26.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:26.776+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:27.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:27.455+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:27.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:27.747+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:28.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:28.416+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:28.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:28.698+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:29.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:29.448+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:29.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:29.692+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:30.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:30.412+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:30.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:30.691+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:31.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:31.372+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:31.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:31.679+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:32.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:32.357+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:32.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:32.654+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:33.352 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:33.350+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:33.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:33.675+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:34.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:34.305+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:34.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:34.725+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:35.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:35.284+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:35.720 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:35.718+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:36.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:36.246+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:36.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:36.692+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:37.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:37.263+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:37.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:37.728+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:38.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:38.270+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:38.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:38.703+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:39.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:39.262+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:39.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:39.728+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:40.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:40.308+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:40.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:40.688+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:41.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:41.334+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:41.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:41.645+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:42.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:42.301+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:42.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:42.645+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:43.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:43.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:43.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:43.652+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:44.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:44.293+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:44.615 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:44.614+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:45.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:45.332+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:45.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:45.568+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:46.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:46.342+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:46.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:46.582+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:47.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:47.334+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:47.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:47.587+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:48.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:48.380+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:48.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:48.620+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:49.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:49.373+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:49.593 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:49.592+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:50.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:50.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:50.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:50.553+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:51.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:51.317+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:51.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:51.556+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:52.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:52.290+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:52.511 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:52.509+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:53.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:53.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:53.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:53.560+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:54.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:54.263+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:54.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:54.535+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:55.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:55.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:55.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:55.498+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:56.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:56.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:56.507 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:56.506+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:57.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:57.296+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:57.525 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:57.524+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:58.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:58.266+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:58.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:58.477+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:59.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:35:59.311+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:35:59.463 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:35:59.462+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:00.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:00.271+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:00.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:00.502+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:01.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:01.306+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:01.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:01.531+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:02.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:02.313+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:02.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:02.540+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:03.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:03.266+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:03.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:03.548+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:04.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:04.299+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:04.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:04.564+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:05.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:05.250+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:05.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:05.609+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:06.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:06.268+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:06.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:06.652+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:07.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:07.298+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:07.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:07.625+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:08.337 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:08.336+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:08.608 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:08.608+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:09.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:09.299+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:09.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:09.650+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:10.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:10.252+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:10.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:10.661+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:11.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:11.280+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:11.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:11.673+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:12.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:12.315+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:12.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:12.705+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:13.355 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:13.353+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:13.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:13.684+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:14.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:14.331+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:14.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:14.643+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:15.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:15.286+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:15.616 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:15.615+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:16.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:16.252+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:16.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:16.579+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:17.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:17.232+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:17.604 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:17.603+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:18.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:18.248+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:18.593 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:18.592+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:19.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:19.244+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:19.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:19.577+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:20.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:20.243+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:20.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:20.583+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:21.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:21.215+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:21.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:21.621+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:22.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:22.167+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:22.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:22.573+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:23.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:23.189+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:23.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:23.569+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:24.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:24.188+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:24.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:24.575+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:25.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:25.146+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:25.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:25.595+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:26.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:26.165+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:26.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:26.575+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:27.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:27.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:27.600 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:27.599+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:28.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:28.110+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:28.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:28.611+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:29.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:29.075+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:29.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:29.584+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:30.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:30.057+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:30.538 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:30.537+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:31.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:31.083+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:31.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:31.494+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:32.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:32.077+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:32.488 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:32.487+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:33.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:33.087+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:33.523 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:33.521+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:34.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:34.111+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:34.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:34.516+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:35.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:35.144+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:35.516 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:35.515+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:36.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:36.132+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:36.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:36.528+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:37.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:37.104+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:37.488 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:37.487+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:38.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:38.116+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:38.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:38.521+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:39.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:39.092+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:39.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:39.484+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:40.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:40.119+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:40.509 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:40.508+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:41.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:41.105+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:41.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:41.556+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:42.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:42.083+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:42.539 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:42.537+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:43.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:43.131+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:43.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:43.581+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:44.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:44.107+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:44.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:44.595+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:45.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:45.144+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:45.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:45.592+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:46.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:46.176+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:46.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:46.570+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:47.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:47.155+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:47.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:47.550+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:48.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:48.110+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:48.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:48.568+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:49.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:49.096+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:49.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:49.585+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:50.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:50.046+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:50.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:50.579+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:51.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:51.053+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:51.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:51.623+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:52.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:52.046+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:52.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:52.609+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:53.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:53.061+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:53.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:53.618+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:54.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:54.072+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:54.654 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:54.654+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:55.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:55.090+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:55.652 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:55.651+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:56.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:56.055+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:56.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:56.674+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:57.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:57.049+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:57.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:57.692+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:58.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:58.007+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:58.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:58.711+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:59.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:59.003+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:59.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:36:59.721+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:36:59.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:36:59.961+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:00.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:00.689+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:00.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:00.959+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:01.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:01.707+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:01.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:01.976+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:02.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:02.721+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:02.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:02.986+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:03.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:03.750+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:04.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:04.023+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:04.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:04.799+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:05.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:05.053+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:05.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:05.767+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:06.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:06.079+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:06.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:06.775+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:07.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:07.034+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:07.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:07.769+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:07.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:07.990+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:08.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:08.740+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:08.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:08.995+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:09.720 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:09.719+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:09.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:09.961+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:10.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:10.752+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:10.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:10.915+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:11.760 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:11.759+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:11.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:11.952+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:12.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:12.762+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:12.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:12.933+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:13.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:13.776+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:13.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:13.945+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:14.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:14.799+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:14.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:14.963+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:15.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:15.831+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:15.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:15.972+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:16.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:16.863+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:17.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:17.008+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:17.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:17.899+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:17.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:17.995+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:18.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:18.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:19.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:19.043+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:19.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:19.882+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:20.027 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:20.026+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:20.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:20.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:20.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:20.987+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:21.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:21.941+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:21.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:21.979+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:22.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:22.940+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:23.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:23.005+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:23.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:23.933+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:24.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:24.041+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:24.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:24.935+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:25.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:25.043+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:25.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:25.906+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:26.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:26.085+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:26.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:26.882+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:27.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:27.093+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:27.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:27.896+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:28.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:28.135+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:28.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:28.858+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:29.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:29.099+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:29.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:29.821+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:30.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:30.054+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:30.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:30.822+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:31.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:31.023+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:31.813 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:31.813+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:32.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:32.021+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:32.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:32.854+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:33.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:33.049+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:33.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:33.867+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:34.099 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:34.099+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:34.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:34.835+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:35.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:35.058+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:35.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:35.843+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:36.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:36.077+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:36.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:36.811+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:37.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:37.098+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:37.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:37.825+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:38.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:38.113+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:38.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:38.809+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:39.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:39.147+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:39.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:39.840+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:40.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:40.127+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:40.815 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:40.814+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:41.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:41.109+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:41.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:41.840+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:42.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:42.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:42.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:42.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:43.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:43.165+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:43.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:43.904+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:44.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:44.200+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:44.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:44.918+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:45.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:45.216+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:45.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:45.950+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:46.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:46.190+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:46.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:46.957+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:47.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:47.230+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:47.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:47.942+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:48.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:48.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:48.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:48.896+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:49.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:49.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:49.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:49.920+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:50.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:50.163+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:50.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:50.934+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:51.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:51.132+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:51.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:51.928+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:52.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:52.136+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:52.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:52.954+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:53.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:53.127+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:53.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:53.936+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:54.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:54.144+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:54.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:54.897+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:55.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:55.122+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:55.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:55.888+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:56.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:56.080+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:56.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:56.896+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:57.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:57.056+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:57.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:57.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:58.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:58.078+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:58.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:58.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:59.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:37:59.108+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:37:59.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:37:59.950+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:00.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:00.105+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:00.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:00.922+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:01.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:01.130+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:01.945 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:01.944+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:02.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:02.145+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:02.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:02.897+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:03.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:03.108+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:03.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:03.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:04.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:04.086+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:04.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:04.908+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:05.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:05.126+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:05.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:05.894+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:06.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:06.120+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:06.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:06.906+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:07.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:07.084+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:07.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:07.937+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:08.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:08.116+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:08.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:08.952+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:09.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:09.122+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:09.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:09.914+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:10.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:10.114+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:10.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:10.964+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:11.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:11.084+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:11.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:11.978+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:12.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:12.053+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:13.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:13.008+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:13.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:13.008+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:13.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:13.965+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:14.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:14.009+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:14.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:14.982+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:15.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:15.005+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:16.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:16.000+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:16.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:16.036+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:17.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:17.025+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:17.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:17.082+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:18.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:18.032+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:18.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:18.118+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:18.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:18.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:19.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:19.168+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:20.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:20.032+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:20.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:20.122+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:21.029 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:21.026+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:21.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:21.129+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:22.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:22.002+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:22.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:22.096+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:22.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:22.975+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:23.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:23.050+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:23.948 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:23.948+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:24.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:24.030+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:24.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:24.931+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:25.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:25.019+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:25.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:25.910+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:26.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:26.023+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:26.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:26.892+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:26.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:26.988+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:27.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:27.895+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:28.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:28.011+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:28.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:28.939+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:29.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:29.018+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:29.905 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:29.903+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:30.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:30.067+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:30.878 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:30.877+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:31.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:31.029+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:31.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:31.885+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:31.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:31.995+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:32.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:32.881+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:32.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:32.977+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:33.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:33.881+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:34.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:34.000+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:34.872 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:34.870+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:34.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:34.977+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:35.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:35.861+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:35.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:35.968+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:36.860 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:36.858+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:36.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:36.927+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:37.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:37.885+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:37.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:37.959+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:38.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:38.923+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:38.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:38.935+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:39.921 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:39.919+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:39.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:39.931+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:40.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:40.897+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:40.899 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:40.898+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:41.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:41.861+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:41.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:41.863+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:42.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:42.905+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:42.910 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:42.909+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:43.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:43.894+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:43.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:43.945+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:44.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:44.889+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:44.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:44.934+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:45.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:45.905+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:45.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:45.920+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:46.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:46.881+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:46.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:46.885+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:47.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:47.871+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:47.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:47.880+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:48.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:48.833+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:48.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:48.838+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:49.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:49.842+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:49.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:49.883+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:50.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:50.882+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:50.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:50.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:51.841 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:51.839+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:51.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:51.867+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:52.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:52.820+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:52.847 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:52.845+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:53.836 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:53.835+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:53.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:53.895+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:54.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:54.857+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:54.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:54.871+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:55.812 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:55.811+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:55.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:55.905+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:56.795 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:56.794+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:56.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:56.882+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:57.750 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:57.749+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:57.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:57.871+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:58.737 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:58.737+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:58.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:58.895+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:59.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:38:59.762+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:38:59.920 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:38:59.919+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:00.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:00.775+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:00.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:00.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:01.754 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:01.753+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:01.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:01.947+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:02.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:02.724+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:02.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:02.939+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:03.729 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:03.728+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:03.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:03.896+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:04.732 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:04.732+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:04.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:04.909+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:05.719 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:05.718+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:05.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:05.948+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:06.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:06.725+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:06.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:06.938+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:07.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:07.684+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:07.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:07.931+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:08.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:08.664+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:08.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:08.923+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:09.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:09.692+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:09.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:09.900+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:10.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:10.643+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:10.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:10.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:11.622 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:11.621+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:11.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:11.901+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:12.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:12.608+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:12.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:12.875+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:13.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:13.575+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:13.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:13.843+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:14.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:14.551+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:14.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:14.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:15.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:15.601+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:15.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:15.784+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:16.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:16.621+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:16.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:16.762+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:17.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:17.575+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:17.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:17.734+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:18.615 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:18.613+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:18.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:18.693+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:19.626 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:19.625+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:19.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:19.681+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:20.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:20.658+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:20.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:20.730+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:21.676 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:21.675+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:21.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:21.702+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:22.686 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:22.685+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:22.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:22.745+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:23.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:23.671+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:23.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:23.765+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:24.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:24.721+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:24.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:24.730+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:25.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:25.695+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:25.717 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:25.715+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:26.736 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:26.734+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:26.738 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:26.737+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:27.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:27.729+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:27.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:27.773+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:28.763 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:28.761+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:28.791 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:28.789+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:29.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:29.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:29.784 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:29.782+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:30.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:30.731+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:30.800 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:30.799+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:31.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:31.769+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:31.838 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:31.837+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:32.760 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:32.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:32.849 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:32.847+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:33.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:33.716+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:33.826 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:33.824+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:34.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:34.667+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:34.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:34.775+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:35.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:35.669+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:35.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:35.769+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:36.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:36.625+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:36.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:36.761+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:37.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:37.586+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:37.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:37.765+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:38.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:38.594+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:38.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:38.777+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:39.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:39.622+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:39.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:39.752+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:40.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:40.604+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:40.705 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:40.704+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:41.607 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:41.606+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:41.694 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:41.692+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:42.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:42.570+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:42.656 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:42.656+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:43.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:43.578+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:43.684 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:43.684+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:44.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:44.592+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:44.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:44.655+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:45.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:45.584+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:45.678 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:45.678+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:46.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:46.574+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:46.640 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:46.639+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:47.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:47.530+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:47.628 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:47.627+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:48.501 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:48.500+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:48.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:48.606+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:49.508 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:49.508+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:49.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:49.559+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:50.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:50.518+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:50.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:50.528+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:51.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:51.486+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:51.539 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:51.539+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:52.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:52.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:52.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:52.550+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:53.511 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:53.510+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:53.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:53.514+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:54.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:54.499+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:54.545 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:54.543+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:55.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:55.538+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:55.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:55.565+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:56.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:56.573+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:56.576 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:56.575+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:57.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:57.607+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:57.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:57.622+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:58.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:58.583+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:58.635 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:58.633+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:59.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:39:59.577+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:39:59.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:39:59.674+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:00.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:00.569+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:00.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:00.691+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:01.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:01.538+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:01.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:01.672+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:02.504 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:02.503+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:02.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:02.641+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:03.456 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:03.454+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:03.656 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:03.655+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:04.421 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:04.419+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:04.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:04.646+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:05.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:05.415+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:05.604 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:05.602+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:06.455 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:06.453+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:06.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:06.607+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:07.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:07.409+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:07.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:07.642+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:08.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:08.387+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:08.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:08.651+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:09.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:09.439+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:09.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:09.624+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:10.437 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:10.435+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:10.604 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:10.602+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:11.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:11.393+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:11.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:11.567+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:12.357 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:12.355+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:12.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:12.555+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:13.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:13.377+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:13.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:13.543+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:14.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:14.349+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:14.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:14.558+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:15.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:15.363+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:15.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:15.579+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:16.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:16.377+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:16.601 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:16.600+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:17.382 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:17.381+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:17.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:17.647+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:18.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:18.364+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:18.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:18.651+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:19.352 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:19.350+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:19.674 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:19.673+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:20.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:20.331+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:20.662 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:20.661+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:21.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:21.308+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:21.711 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:21.710+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:22.349 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:22.348+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:22.702 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:22.701+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:23.372 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:23.370+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:23.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:23.720+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:24.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:24.388+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:24.738 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:24.737+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:25.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:25.363+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:25.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:25.760+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:26.354 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:26.353+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:26.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:26.721+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:27.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:27.321+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:27.702 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:27.702+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:28.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:28.289+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:28.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:28.724+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:29.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:29.265+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:29.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:29.725+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:30.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:30.298+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:30.700 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:30.700+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:31.317 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:31.317+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:31.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:31.673+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:32.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:32.307+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:32.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:32.659+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:33.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:33.273+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:33.674 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:33.674+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:34.307 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:34.306+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:34.657 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:34.656+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:35.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:35.310+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:35.677 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:35.677+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:36.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:36.320+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:36.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:36.692+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:37.316 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:37.315+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:37.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:37.724+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:38.363 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:38.363+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:38.740 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:38.739+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:39.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:39.350+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:39.713 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:39.711+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:40.349 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:40.345+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:40.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:40.694+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:41.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:41.314+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:41.743 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:41.741+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:42.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:42.276+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:42.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:42.708+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:43.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:43.297+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:43.759 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:43.757+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:44.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:44.300+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:44.790 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:44.788+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:45.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:45.261+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:45.768 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:45.766+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:46.313 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:46.312+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:46.747 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:46.745+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:47.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:47.310+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:47.711 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:47.710+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:48.325 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:48.323+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:48.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:48.740+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:49.328 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:49.326+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:49.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:49.723+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:50.367 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:50.366+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:50.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:50.694+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:51.349 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:51.347+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:51.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:51.683+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:52.355 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:52.354+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:52.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:52.696+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:53.385 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:53.383+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:53.716 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:53.715+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:54.369 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:54.368+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:54.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:54.732+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:55.373 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:55.371+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:55.736 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:55.734+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:56.386 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:56.384+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:56.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:56.776+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:57.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:57.374+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:57.759 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:57.758+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:58.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:58.416+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:58.801 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:58.799+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:59.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:40:59.403+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:40:59.830 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:40:59.829+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:00.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:00.392+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:00.861 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:00.859+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:01.383 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:01.382+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:01.889 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:01.888+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:02.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:02.426+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:02.931 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:02.929+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:03.410 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:03.408+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:03.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:03.927+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:04.372 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:04.371+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:04.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:04.955+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:05.367 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:05.366+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:05.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:05.998+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:06.375 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:06.374+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:07.041 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:07.039+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:07.385 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:07.383+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:08.034 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T04:41:08.032+0000 7efd7fbac700 0 -- 172.21.15.134:0/875767599 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x7efd64030040 msgr2=0x7efd64087160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T04:41:08.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:08.050+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:08.337 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:08.336+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:09.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:09.006+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:09.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:09.377+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:10.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:10.056+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:10.408 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:10.406+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:11.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:11.063+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:11.373 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:11.373+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:12.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:12.057+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:12.409 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:12.408+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:13.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:13.028+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:13.458 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:13.457+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:14.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:14.068+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:14.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:14.443+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:15.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:15.056+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:15.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:15.403+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:16.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:16.106+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:16.446 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:16.446+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:17.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:17.086+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:17.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:17.452+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:18.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:18.088+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:18.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:18.478+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:19.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:19.096+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:19.432 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:19.432+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:20.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:20.133+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:20.386 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:20.386+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:21.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:21.089+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:21.345 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:21.344+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:22.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:22.087+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:22.356 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:22.356+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:23.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:23.070+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:23.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:23.382+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:24.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:24.061+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:24.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:24.365+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:25.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:25.091+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:25.349 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:25.347+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:26.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:26.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:26.343 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:26.341+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:27.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:27.155+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:27.355 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:27.354+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:28.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:28.186+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:28.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:28.349+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:29.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:29.221+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:29.339 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:29.338+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:30.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:30.179+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:30.341 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:30.339+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:31.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:31.223+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:31.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:31.349+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:32.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:32.199+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:32.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:32.303+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:33.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:33.203+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:33.334 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:33.333+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:34.246 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:34.245+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:34.344 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:34.343+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:35.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:35.289+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:35.362 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:35.361+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:36.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:36.286+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:36.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:36.347+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:37.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:37.319+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:37.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:37.328+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:38.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:38.284+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:38.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:38.334+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:39.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:39.299+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:39.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:39.299+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:40.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:40.288+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:40.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:40.299+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:41.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:41.281+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:41.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:41.313+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:42.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:42.315+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:42.320 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:42.319+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:43.330 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:43.328+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:43.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:43.353+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:44.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:44.318+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:44.357 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:44.355+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:45.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:45.341+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:45.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:45.395+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:46.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:46.374+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:46.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:46.401+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:47.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:47.331+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:47.418 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:47.414+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:48.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:48.344+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:48.400 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:48.399+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:49.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:49.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:49.352 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:49.351+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:50.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:50.377+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:50.381 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:50.380+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:51.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:51.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:51.392 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:51.391+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:52.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:52.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:52.416 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:52.415+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:53.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:53.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:53.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:53.425+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:54.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:54.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:54.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:54.442+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:55.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:55.261+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:55.486 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:55.485+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:56.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:56.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:56.468 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:56.468+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:57.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:57.186+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:57.483 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:57.483+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:58.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:58.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:58.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:58.457+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:59.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:41:59.275+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:41:59.424 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:41:59.424+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:00.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:00.281+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:00.471 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:00.471+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:01.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:01.283+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:01.509 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:01.509+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:02.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:02.235+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:02.528 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:02.527+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:03.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:03.207+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:03.490 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:03.490+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:04.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:04.243+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:04.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:04.515+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:05.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:05.237+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:05.524 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:05.523+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:06.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:06.250+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:06.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:06.561+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:07.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:07.280+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:07.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:07.609+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:08.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:08.271+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:08.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:08.572+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:09.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:09.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:09.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:09.554+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:10.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:10.261+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:10.520 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:10.518+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:11.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:11.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:11.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:11.473+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:12.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:12.299+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:12.436 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:12.434+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:13.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:13.306+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:13.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:13.452+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:14.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:14.352+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:14.459 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:14.457+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:15.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:15.379+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:15.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:15.451+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:16.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:16.401+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:16.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:16.416+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:17.382 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:17.380+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:17.416 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:17.414+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:18.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:18.372+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:18.374 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:18.372+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:19.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:19.375+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:19.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:19.402+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:20.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:20.374+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:20.395 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:20.394+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:21.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:21.347+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:21.349 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:21.348+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:22.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:22.325+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:22.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:22.395+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:23.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:23.357+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:23.421 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:23.420+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:24.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:24.340+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:24.451 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:24.450+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:25.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:25.348+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:25.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:25.492+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:26.352 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:26.351+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:26.456 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:26.454+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:27.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:27.314+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:27.505 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:27.504+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:28.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:28.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:28.513 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:28.512+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:29.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:29.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:29.487 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:29.486+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:30.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:30.247+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:30.487 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:30.486+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:31.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:31.206+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:31.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:31.493+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:32.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:32.209+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:32.516 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:32.515+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:33.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:33.178+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:33.513 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:33.511+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:34.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:34.162+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:34.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:34.530+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:35.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:35.128+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:35.536 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:35.535+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:36.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:36.145+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:36.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:36.563+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:37.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:37.192+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:37.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:37.594+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:38.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:38.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:38.614 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:38.613+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:39.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:39.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:39.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:39.595+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:40.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:40.255+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:40.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:40.645+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:41.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:41.243+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:41.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:41.649+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:42.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:42.228+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:42.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:42.626+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:43.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:43.195+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:43.621 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:43.621+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:44.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:44.216+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:44.645 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:44.644+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:45.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:45.215+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:45.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:45.681+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:46.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:46.241+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:46.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:46.665+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:47.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:47.253+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:47.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:47.705+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:48.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:48.237+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:48.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:48.753+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:49.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:49.275+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:49.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:49.776+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:50.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:50.319+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:50.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:50.763+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:51.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:51.309+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:51.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:51.740+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:52.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:52.338+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:52.720 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:52.719+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:53.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:53.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:53.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:53.762+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:54.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:54.333+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:54.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:54.807+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:55.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:55.367+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:55.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:55.836+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:56.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:56.369+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:56.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:56.845+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:57.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:57.324+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:57.879 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:57.878+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:58.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:58.358+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:58.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:58.872+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:59.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:42:59.355+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:42:59.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:42:59.869+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:00.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:00.377+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:00.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:00.888+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:01.379 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:01.377+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:01.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:01.882+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:02.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:02.366+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:02.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:02.911+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:03.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:03.337+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:03.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:03.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:04.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:04.382+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:04.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:04.886+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:05.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:05.347+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:05.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:05.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:06.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:06.310+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:06.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:06.848+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:07.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:07.356+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:07.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:07.836+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:08.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:08.373+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:08.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:08.834+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:09.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:09.394+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:09.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:09.848+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:10.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:10.376+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:10.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:10.826+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:11.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:11.367+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:11.783 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:11.781+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:12.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:12.342+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:12.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:12.742+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:13.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:13.323+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:13.783 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:13.781+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:14.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:14.276+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:14.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:14.816+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:15.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:15.261+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:15.854 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:15.853+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:16.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:16.259+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:16.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:16.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:17.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:17.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:17.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:17.899+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:18.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:18.220+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:18.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:18.949+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:19.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:19.213+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:19.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:19.958+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:20.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:20.198+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:20.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:20.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:21.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:21.196+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:21.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:21.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:22.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:22.212+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:22.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:22.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:23.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:23.205+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:23.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:23.889+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:24.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:24.188+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:24.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:24.901+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:25.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:25.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:25.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:25.917+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:26.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:26.200+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:26.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:26.929+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:27.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:27.219+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:27.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:27.933+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:28.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:28.191+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:28.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:28.889+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:29.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:29.203+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:29.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:29.858+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:30.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:30.158+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:30.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:30.827+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:31.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:31.135+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:31.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:31.800+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:32.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:32.135+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:32.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:32.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:33.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:33.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:33.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:33.746+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:34.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:34.177+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:34.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:34.793+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:35.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:35.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:35.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:35.807+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:36.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:36.236+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:36.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:36.800+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:37.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:37.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:37.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:37.785+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:38.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:38.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:38.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:38.812+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:39.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:39.121+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:39.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:39.826+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:40.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:40.102+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:40.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:40.844+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:41.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:41.104+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:41.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:41.889+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:42.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:42.146+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:42.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:42.911+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:43.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:43.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:43.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:43.892+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:44.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:44.136+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:44.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:44.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:45.151 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:45.149+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:45.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:45.906+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:46.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:46.143+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:46.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:46.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:47.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:47.182+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:47.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:47.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:48.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:48.197+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:48.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:48.910+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:49.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:49.235+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:49.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:49.910+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:50.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:50.212+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:50.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:50.954+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:51.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:51.240+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:51.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:51.962+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:52.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:52.267+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:52.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:52.941+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:53.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:53.247+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:53.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:53.991+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:54.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:54.243+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:54.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:54.986+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:55.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:55.201+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:56.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:56.014+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:56.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:56.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:57.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:57.024+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:57.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:57.230+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:57.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:57.997+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:58.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:58.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:58.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:58.970+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:59.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:43:59.230+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:43:59.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:43:59.926+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:00.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:00.279+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:00.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:00.906+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:01.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:01.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:01.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:01.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:02.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:02.280+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:02.854 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:02.853+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:03.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:03.326+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:03.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:03.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:04.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:04.351+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:04.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:04.868+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:05.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:05.390+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:05.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:05.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:06.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:06.363+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:06.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:06.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:07.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:07.373+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:07.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:07.868+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:08.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:08.422+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:08.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:08.833+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:09.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:09.453+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:09.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:09.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:10.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:10.432+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:10.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:10.906+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:11.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:11.480+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:11.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:11.935+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:12.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:12.452+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:12.895 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:12.895+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:13.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:13.464+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:13.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:13.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:14.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:14.505+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:14.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:14.894+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:15.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:15.495+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:15.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:15.892+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:16.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:16.469+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:16.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:16.862+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:17.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:17.444+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:17.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:17.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:18.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:18.450+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:18.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:18.879+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:19.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:19.437+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:19.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:19.850+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:20.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:20.429+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:20.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:20.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:21.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:21.423+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:21.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:21.880+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:22.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:22.410+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:22.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:22.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:23.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:23.437+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:23.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:23.792+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:24.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:24.466+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:24.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:24.768+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:25.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:25.457+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:25.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:25.801+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:26.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:26.419+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:26.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:26.754+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:27.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:27.386+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:27.724 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:27.722+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:28.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:28.363+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:28.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:28.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:29.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:29.405+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:29.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:29.809+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:30.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:30.359+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:30.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:30.811+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:31.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:31.398+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:31.854 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:31.853+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:32.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:32.399+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:32.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:32.851+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:33.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:33.351+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:33.863 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:33.862+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:34.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:34.322+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:34.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:34.904+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:35.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:35.307+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:35.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:35.946+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:36.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:36.309+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:36.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:36.957+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:37.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:37.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:38.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:38.003+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:38.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:38.263+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:39.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:39.001+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:39.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:39.269+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:39.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:39.967+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:40.226 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:40.225+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:40.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:40.927+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:41.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:41.216+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:41.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:41.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:42.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:42.184+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:42.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:42.918+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:43.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:43.199+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:43.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:43.969+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:44.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:44.219+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:44.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:44.963+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:45.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:45.253+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:46.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:46.005+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:46.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:46.211+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:47.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:47.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:47.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:47.253+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:47.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:47.976+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:48.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:48.294+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:49.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:49.005+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:49.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:49.254+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:50.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:50.020+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:50.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:50.238+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:50.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:50.988+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:51.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:51.203+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:51.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:51.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:52.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:52.199+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:53.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:53.001+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:53.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:53.156+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:54.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:54.032+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:54.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:54.125+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:55.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:55.080+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:55.099 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:55.099+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:56.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:56.061+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:56.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:56.121+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:57.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:57.024+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:57.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:57.092+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:57.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:57.987+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:58.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:58.091+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:59.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:44:59.005+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:44:59.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:44:59.098+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:00.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:00.017+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:00.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:00.092+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:01.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:01.012+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:01.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:01.046+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:02.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:02.004+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:02.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:02.026+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:03.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:03.019+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:03.052 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:03.051+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:03.972 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:03.971+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:04.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:04.067+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:05.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:05.000+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:05.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:05.045+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:05.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:05.958+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:06.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:06.064+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:06.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:06.958+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:07.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:07.016+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:08.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:08.008+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:08.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:08.055+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:08.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:08.976+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:09.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:09.057+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:09.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:09.977+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:10.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:10.023+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:10.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:10.965+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:11.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:11.058+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:11.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:11.931+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:12.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:12.079+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:12.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:12.966+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:13.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:13.079+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:13.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:13.942+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:14.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:14.032+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:14.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:14.982+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:15.005 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:15.004+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:16.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:16.014+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:16.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:16.043+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:16.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:16.986+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:17.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:17.040+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:17.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:17.975+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:18.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:18.024+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:18.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:18.938+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:19.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:19.047+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:19.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:19.939+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:20.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:20.024+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:20.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:20.968+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:21.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:21.033+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:21.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:21.991+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:22.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:22.065+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:22.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:22.989+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:23.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:23.068+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:23.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:23.989+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:24.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:24.119+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:24.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:24.980+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:25.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:25.101+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:26.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:26.028+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:26.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:26.111+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:27.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:27.015+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:27.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:27.077+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:28.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:28.025+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:28.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:28.031+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:28.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:28.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:29.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:29.042+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:29.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:29.963+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:30.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:30.086+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:30.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:30.989+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:31.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:31.113+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:31.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:31.957+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:32.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:32.084+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:32.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:32.926+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:33.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:33.101+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:33.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:33.917+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:34.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:34.131+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:34.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:34.913+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:35.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:35.091+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:35.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:35.918+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:36.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:36.056+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:36.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:36.935+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:37.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:37.094+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:37.931 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:37.931+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:38.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:38.140+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:38.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:38.914+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:39.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:39.180+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:39.905 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:39.905+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:40.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:40.166+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:40.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:40.922+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:41.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:41.186+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:41.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:41.906+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:42.179 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:42.179+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:42.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:42.941+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:43.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:43.211+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:43.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:43.976+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:44.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:44.218+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:45.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:45.019+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:45.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:45.222+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:45.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:45.985+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:46.197 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:46.196+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:46.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:46.983+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:47.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:47.215+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:47.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:47.937+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:48.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:48.257+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:48.948 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:48.947+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:49.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:49.247+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:49.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:49.932+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:50.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:50.203+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:50.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:50.977+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:51.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:51.253+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:51.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:51.938+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:52.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:52.267+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:52.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:52.921+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:53.245 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:53.244+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:53.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:53.929+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:54.201 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:54.200+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:54.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:54.949+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:55.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:55.187+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:55.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:55.989+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:56.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:56.208+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:56.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:56.963+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:57.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:57.181+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:57.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:57.941+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:58.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:58.149+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:58.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:58.958+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:59.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:45:59.101+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:45:59.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:45:59.946+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:00.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:00.086+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:00.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:00.989+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:01.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:01.084+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:01.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:01.987+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:02.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:02.111+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:02.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:02.983+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:03.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:03.068+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:03.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:03.971+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:04.033 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:04.032+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:04.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:04.973+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:05.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:05.074+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:05.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:05.981+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:06.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:06.083+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:07.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:07.027+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:07.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:07.049+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:07.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:07.998+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:08.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:08.019+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:08.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:08.979+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:09.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:09.067+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:09.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:09.975+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:10.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:10.077+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:10.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:10.955+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:11.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:11.077+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:11.965 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:11.964+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:12.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:12.085+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:12.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:12.959+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:13.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:13.120+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:13.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:13.956+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:14.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:14.099+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:14.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:14.991+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:15.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:15.106+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:15.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:15.944+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:16.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:16.097+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:16.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:16.943+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:17.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:17.074+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:17.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:17.909+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:18.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:18.065+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:18.917 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:18.917+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:19.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:19.067+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:19.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:19.881+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:20.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:20.023+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:20.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:20.915+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:21.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:21.039+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:21.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:21.941+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:21.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:21.999+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:22.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:22.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:22.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:22.974+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:23.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:23.941+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:24.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:24.023+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:24.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:24.944+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:24.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:24.997+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:25.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:25.958+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:26.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:26.033+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:26.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:26.923+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:27.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:27.078+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:27.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:27.917+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:28.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:28.045+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:28.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:28.891+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:29.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:29.030+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:29.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:29.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:30.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:30.036+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:30.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:30.900+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:31.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:31.016+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:31.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:31.948+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:31.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:31.973+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:32.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:32.958+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:32.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:32.984+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:33.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:33.922+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:34.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:34.009+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:34.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:34.947+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:35.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:35.008+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:35.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:35.979+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:36.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:36.049+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:37.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:37.018+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:37.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:37.064+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:38.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:38.046+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:38.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:38.104+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:39.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:39.048+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:39.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:39.119+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:40.053 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:40.052+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:40.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:40.144+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:41.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:41.090+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:41.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:41.098+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:42.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:42.113+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:42.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:42.122+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:43.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:43.099+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:43.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:43.103+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:44.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:44.060+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:44.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:44.076+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:45.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:45.033+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:45.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:45.081+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:46.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:46.073+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:46.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:46.078+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:47.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:47.042+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:47.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:47.066+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:48.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:48.048+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:48.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:48.090+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:49.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:49.086+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:49.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:49.092+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:50.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:50.096+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:50.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:50.113+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:51.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:51.068+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:51.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:51.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:52.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:52.068+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:52.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:52.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:53.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:53.067+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:53.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:53.173+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:54.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:54.071+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:54.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:54.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:55.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:55.027+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:55.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:55.207+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:56.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:56.029+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:56.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:56.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:57.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:57.020+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:57.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:57.224+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:58.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:58.067+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:58.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:58.267+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:59.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:46:59.079+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:46:59.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:46:59.229+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:00.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:00.037+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:00.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:00.215+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:01.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:01.021+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:01.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:01.263+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:02.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:02.031+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:02.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:02.237+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:03.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:03.040+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:03.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:03.200+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:04.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:04.003+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:04.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:04.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:04.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:04.968+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:05.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:05.238+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:05.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:05.986+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:06.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:06.269+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:07.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:07.009+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:07.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:07.318+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:07.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:07.980+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:08.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:08.274+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:08.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:08.994+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:09.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:09.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:09.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:09.968+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:10.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:10.281+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:10.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:10.980+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:11.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:11.318+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:12.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:12.025+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:12.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:12.361+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:12.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:12.978+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:13.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:13.320+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:14.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:14.011+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:14.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:14.319+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:14.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:14.987+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:15.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:15.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:15.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:15.966+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:16.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:16.253+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:17.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:17.005+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:17.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:17.267+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:18.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:18.011+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:18.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:18.246+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:18.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:18.980+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:19.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:19.285+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:20.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:20.019+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:20.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:20.323+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:20.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:20.976+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:21.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:21.317+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:21.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:21.972+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:22.291 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:22.290+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:22.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:22.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:23.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:23.284+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:23.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:23.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:24.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:24.289+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:24.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:24.913+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:25.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:25.317+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:25.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:25.958+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:26.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:26.302+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:26.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:26.931+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:27.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:27.287+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:27.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:27.897+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:28.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:28.307+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:28.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:28.875+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:29.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:29.279+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:29.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:29.908+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:30.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:30.319+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:30.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:30.947+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:31.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:31.305+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:31.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:31.911+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:32.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:32.287+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:32.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:32.949+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:33.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:33.267+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:33.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:33.987+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:34.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:34.229+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:35.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:35.017+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:35.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:35.258+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:36.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:36.035+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:36.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:36.209+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:37.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:37.079+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:37.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:37.181+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:38.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:38.113+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:38.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:38.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:39.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:39.102+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:39.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:39.253+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:40.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:40.152+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:40.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:40.255+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:41.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:41.105+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:41.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:41.293+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:42.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:42.081+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:42.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:42.316+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:43.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:43.111+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:43.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:43.338+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:44.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:44.154+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:44.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:44.379+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:45.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:45.120+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:45.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:45.370+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:46.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:46.098+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:46.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:46.325+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:47.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:47.131+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:47.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:47.282+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:48.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:48.130+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:48.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:48.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:49.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:49.089+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:49.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:49.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:50.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:50.092+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:50.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:50.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:51.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:51.064+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:51.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:51.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:52.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:52.027+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:52.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:52.218+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:53.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:53.016+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:53.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:53.216+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:54.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:54.054+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:54.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:54.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:55.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:55.094+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:55.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:55.250+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:56.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:56.047+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:56.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:56.296+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:57.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:57.034+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:57.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:57.288+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:58.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:58.058+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:58.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:58.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:59.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:47:59.052+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:47:59.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:47:59.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:00.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:00.029+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:00.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:00.308+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:01.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:01.011+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:01.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:01.345+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:02.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:02.061+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:02.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:02.341+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:03.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:03.064+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:03.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:03.314+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:04.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:04.072+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:04.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:04.343+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:05.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:05.073+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:05.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:05.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:06.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:06.096+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:06.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:06.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:07.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:07.133+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:07.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:07.279+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:08.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:08.180+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:08.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:08.275+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:09.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:09.221+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:09.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:09.293+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:10.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:10.193+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:10.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:10.284+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:11.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:11.218+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:11.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:11.271+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:12.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:12.236+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:12.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:12.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:13.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:13.213+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:13.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:13.299+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:14.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:14.242+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:14.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:14.253+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:15.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:15.214+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:15.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:15.291+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:16.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:16.188+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:16.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:16.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:17.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:17.215+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:17.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:17.317+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:18.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:18.262+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:18.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:18.355+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:19.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:19.271+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:19.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:19.315+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:20.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:20.234+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:20.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:20.288+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:21.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:21.246+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:21.276 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:21.275+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:22.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:22.221+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:22.285 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:22.284+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:23.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:23.191+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:23.324 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:23.323+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:24.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:24.236+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:24.328 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:24.327+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:25.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:25.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:25.319 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:25.318+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:26.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:26.267+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:26.356 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:26.355+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:27.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:27.261+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:27.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:27.313+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:28.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:28.278+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:28.342 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:28.341+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:29.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:29.285+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:29.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:29.314+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:30.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:30.265+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:30.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:30.301+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:31.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:31.282+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:31.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:31.283+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:32.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:32.299+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:32.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:32.308+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:33.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:33.293+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:33.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:33.301+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:34.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:34.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:34.317 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:34.316+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:35.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:35.277+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:35.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:35.313+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:36.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:36.277+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:36.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:36.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:37.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:37.255+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:37.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:37.325+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:38.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:38.217+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:38.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:38.333+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:39.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:39.225+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:39.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:39.306+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:40.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:40.195+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:40.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:40.280+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:41.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:41.236+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:41.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:41.245+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:42.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:42.197+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:42.201 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:42.201+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:43.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:43.152+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:43.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:43.186+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:44.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:44.131+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:44.163 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:44.162+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:45.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:45.126+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:45.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:45.165+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:46.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:46.095+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:46.163 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:46.162+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:47.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:47.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:47.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:47.212+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:48.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:48.109+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:48.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:48.184+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:49.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:49.125+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:49.201 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:49.200+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:50.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:50.156+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:50.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:50.208+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:51.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:51.156+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:51.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:51.225+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:52.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:52.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:52.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:52.180+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:53.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:53.100+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:53.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:53.179+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:54.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:54.060+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:54.175 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:54.174+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:55.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:55.036+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:55.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:55.184+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:56.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:56.071+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:56.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:56.165+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:57.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:57.052+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:57.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:57.206+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:58.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:58.088+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:58.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:58.158+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:59.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:48:59.090+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:48:59.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:48:59.181+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:00.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:00.060+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:00.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:00.176+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:01.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:01.074+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:01.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:01.133+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:02.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:02.121+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:02.145 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:02.144+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:03.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:03.138+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:03.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:03.138+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:04.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:04.134+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:04.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:04.164+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:05.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:05.111+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:05.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:05.156+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:06.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:06.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:06.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:06.193+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:07.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:07.147+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:07.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:07.166+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:08.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:08.176+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:08.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:08.195+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:09.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:09.145+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:09.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:09.223+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:10.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:10.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:10.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:10.228+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:11.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:11.154+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:11.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:11.248+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:12.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:12.172+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:12.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:12.205+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:13.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:13.220+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:13.238 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:13.237+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:14.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:14.270+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:14.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:14.277+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:15.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:15.241+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:15.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:15.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:16.245 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:16.244+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:16.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:16.283+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:17.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:17.275+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:17.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:17.279+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:18.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:18.239+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:18.285 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:18.285+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:19.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:19.223+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:19.318 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:19.317+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:20.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:20.206+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:20.335 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:20.335+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:21.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:21.217+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:21.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:21.287+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:22.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:22.247+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:22.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:22.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:23.207 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:23.207+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:23.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:23.271+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:24.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:24.215+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:24.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:24.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:25.251 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:25.251+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:25.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:25.255+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:26.245 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:26.244+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:26.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:26.261+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:27.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:27.240+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:27.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:27.288+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:28.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:28.247+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:28.267 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:28.266+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:29.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:29.238+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:29.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:29.293+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:30.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:30.208+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:30.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:30.285+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:31.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:31.170+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:31.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:31.282+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:32.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:32.170+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:32.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:32.273+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:33.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:33.145+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:33.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:33.241+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:34.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:34.170+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:34.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:34.274+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:35.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:35.172+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:35.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:35.257+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:36.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:36.204+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:36.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:36.254+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:37.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:37.172+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:37.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:37.240+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:38.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:38.132+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:38.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:38.286+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:39.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:39.169+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:39.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:39.324+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:40.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:40.137+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:40.356 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:40.355+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:41.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:41.144+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:41.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:41.388+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:42.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:42.145+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:42.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:42.382+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:43.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:43.120+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:43.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:43.410+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:44.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:44.150+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:44.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:44.412+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:45.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:45.156+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:45.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:45.427+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:46.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:46.194+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:46.463 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:46.462+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:47.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:47.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:47.423 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:47.422+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:48.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:48.252+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:48.385 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:48.384+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:49.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:49.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:49.401 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:49.400+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:50.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:50.262+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:50.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:50.426+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:51.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:51.236+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:51.466 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:51.464+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:52.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:52.230+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:52.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:52.494+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:53.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:53.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:53.451 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:53.450+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:54.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:54.230+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:54.490 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:54.488+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:55.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:55.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:55.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:55.504+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:56.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:56.274+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:56.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:56.554+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:57.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:57.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:57.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:57.580+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:58.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:58.218+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:58.617 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:58.616+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:59.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:49:59.237+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:49:59.615 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:49:59.615+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:00.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:00.225+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:00.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:00.641+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:01.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:01.194+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:01.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:01.623+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:02.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:02.163+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:02.621 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:02.621+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:03.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:03.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:03.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:03.592+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:04.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:04.227+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:04.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:04.638+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:05.259 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:05.259+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:05.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:05.674+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:06.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:06.223+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:06.645 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:06.645+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:07.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:07.225+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:07.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:07.668+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:08.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:08.197+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:08.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:08.665+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:09.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:09.185+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:09.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:09.699+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:10.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:10.152+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:10.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:10.742+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:11.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:11.163+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:11.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:11.786+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:12.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:12.182+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:12.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:12.738+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:13.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:13.220+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:13.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:13.742+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:14.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:14.245+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:14.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:14.770+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:15.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:15.204+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:15.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:15.770+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:16.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:16.193+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:16.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:16.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:17.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:17.192+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:17.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:17.775+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:18.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:18.209+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:18.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:18.736+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:19.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:19.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:19.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:19.777+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:20.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:20.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:20.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:20.752+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:21.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:21.296+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:21.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:21.721+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:22.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:22.248+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:22.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:22.705+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:23.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:23.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:23.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:23.688+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:24.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:24.308+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:24.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:24.645+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:25.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:25.310+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:25.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:25.604+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:26.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:26.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:26.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:26.626+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:27.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:27.263+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:27.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:27.590+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:28.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:28.235+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:28.607 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:28.606+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:29.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:29.268+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:29.583 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:29.582+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:30.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:30.258+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:30.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:30.594+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:31.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:31.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:31.630 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:31.628+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:32.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:32.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:32.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:32.626+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:33.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:33.266+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:33.617 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:33.616+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:34.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:34.228+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:34.652 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:34.650+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:35.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:35.227+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:35.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:35.684+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:36.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:36.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:36.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:36.710+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:37.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:37.200+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:37.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:37.741+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:38.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:38.236+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:38.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:38.720+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:39.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:39.224+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:39.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:39.687+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:40.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:40.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:40.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:40.716+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:41.259 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:41.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:41.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:41.706+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:42.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:42.213+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:42.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:42.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:43.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:43.207+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:43.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:43.803+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:44.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:44.215+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:44.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:44.769+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:45.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:45.169+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:45.781 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:45.781+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:46.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:46.155+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:46.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:46.779+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:47.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:47.199+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:47.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:47.823+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:48.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:48.228+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:48.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:48.816+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:49.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:49.179+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:49.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:49.785+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:50.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:50.227+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:50.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:50.820+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:51.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:51.275+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:51.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:51.842+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:52.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:52.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:52.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:52.807+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:53.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:53.236+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:53.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:53.810+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:54.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:54.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:54.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:54.773+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:55.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:55.228+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:55.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:55.778+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:56.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:56.183+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:56.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:56.775+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:57.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:57.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:57.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:57.803+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:58.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:58.264+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:58.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:58.772+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:59.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:50:59.306+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:50:59.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:50:59.731+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:00.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:00.313+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:00.760 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:00.759+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:01.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:01.275+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:01.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:01.718+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:02.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:02.316+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:02.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:02.712+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:03.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:03.342+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:03.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:03.734+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:04.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:04.327+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:04.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:04.750+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:05.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:05.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:05.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:05.728+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:06.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:06.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:06.724 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:06.723+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:07.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:07.323+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:07.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:07.738+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:08.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:08.275+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:08.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:08.757+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:09.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:09.283+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:09.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:09.735+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:10.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:10.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:10.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:10.752+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:11.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:11.311+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:11.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:11.723+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:12.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:12.299+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:12.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:12.764+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:13.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:13.254+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:13.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:13.803+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:14.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:14.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:14.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:14.816+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:15.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:15.232+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:15.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:15.850+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:16.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:16.264+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:16.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:16.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:17.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:17.296+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:17.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:17.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:18.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:18.305+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:18.815 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:18.814+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:19.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:19.317+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:19.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:19.841+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:20.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:20.345+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:20.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:20.796+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:21.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:21.334+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:21.813 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:21.812+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:22.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:22.314+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:22.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:22.844+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:23.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:23.273+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:23.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:23.804+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:24.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:24.316+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:24.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:24.848+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:25.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:25.294+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:25.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:25.854+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:26.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:26.338+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:26.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:26.861+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:27.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:27.331+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:27.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:27.884+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:28.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:28.336+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:28.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:28.904+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:29.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:29.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:29.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:29.942+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:30.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:30.318+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:30.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:30.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:31.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:31.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:31.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:31.882+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:32.291 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:32.291+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:32.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:32.932+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:33.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:33.330+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:33.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:33.978+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:34.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:34.320+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:34.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:34.958+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:35.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:35.319+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:35.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:35.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:36.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:36.298+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:36.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:36.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:37.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:37.318+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:37.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:37.922+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:38.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:38.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:38.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:38.892+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:39.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:39.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:39.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:39.849+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:40.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:40.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:40.820 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:40.819+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:41.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:41.263+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:41.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:41.806+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:42.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:42.227+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:42.811 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:42.809+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:43.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:43.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:43.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:43.789+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:44.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:44.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:44.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:44.764+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:45.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:45.294+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:45.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:45.774+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:46.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:46.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:46.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:46.795+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:47.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:47.332+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:47.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:47.807+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:48.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:48.382+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:48.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:48.767+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:49.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:49.424+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:49.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:49.792+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:50.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:50.392+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:50.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:50.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:51.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:51.417+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:51.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:51.808+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:52.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:52.391+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:52.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:52.785+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:53.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:53.361+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:53.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:53.821+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:54.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:54.363+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:54.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:54.826+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:55.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:55.370+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:55.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:55.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:56.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:56.355+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:56.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:56.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:57.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:57.388+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:57.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:57.846+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:58.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:58.389+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:58.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:58.829+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:59.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:51:59.371+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:51:59.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:51:59.861+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:00.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:00.357+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:00.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:00.891+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:01.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:01.382+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:01.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:01.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:02.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:02.345+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:02.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:02.928+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:03.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:03.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:03.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:03.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:04.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:04.321+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:04.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:04.932+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:05.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:05.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:05.895 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:05.894+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:06.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:06.365+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:06.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:06.937+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:07.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:07.321+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:07.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:07.900+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:08.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:08.343+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:08.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:08.923+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:09.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:09.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:09.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:09.970+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:10.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:10.289+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:10.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:10.985+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:11.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:11.324+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:11.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:11.995+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:12.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:12.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:12.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:12.989+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:13.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:13.262+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:14.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:14.027+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:14.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:14.243+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:15.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:15.008+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:15.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:15.289+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:16.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:16.020+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:16.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:16.334+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:17.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:17.000+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:17.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:17.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:18.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:18.018+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:18.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:18.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:19.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:19.003+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:19.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:19.283+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:20.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:20.016+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:20.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:20.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:21.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:21.054+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:21.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:21.239+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:22.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:22.016+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:22.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:22.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:23.029 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:23.028+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:23.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:23.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:24.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:24.031+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:24.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:24.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:25.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:25.060+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:25.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:25.261+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:26.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:26.046+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:26.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:26.287+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:27.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:27.075+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:27.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:27.275+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:28.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:28.087+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:28.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:28.267+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:29.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:29.040+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:29.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:29.220+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:29.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:29.992+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:30.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:30.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:31.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:31.036+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:31.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:31.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:32.033 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:32.031+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:32.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:32.308+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:33.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:33.021+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:33.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:33.304+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:34.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:34.027+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:34.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:34.305+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:34.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:34.996+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:35.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:35.266+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:36.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:36.018+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:36.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:36.268+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:36.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:36.990+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:37.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:37.276+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:38.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:38.022+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:38.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:38.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:38.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:38.988+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:39.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:39.296+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:40.033 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:40.032+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:40.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:40.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:41.040 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:41.038+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:41.259 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:41.258+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:42.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:42.041+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:42.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:42.244+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:43.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:43.048+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:43.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:43.244+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:44.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:44.050+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:44.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:44.267+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:45.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:45.012+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:45.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:45.280+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:45.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:45.984+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:46.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:46.294+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:46.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:46.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:47.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:47.250+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:47.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:47.947+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:48.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:48.243+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:48.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:48.899+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:49.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:49.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:49.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:49.936+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:50.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:50.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:50.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:50.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:51.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:51.344+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:51.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:51.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:52.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:52.366+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:52.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:52.950+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:53.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:53.343+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:53.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:53.961+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:54.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:54.348+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:54.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:54.915+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:55.386 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:55.386+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:55.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:55.873+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:56.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:56.392+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:56.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:56.893+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:57.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:57.400+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:57.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:57.932+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:58.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:58.376+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:58.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:58.951+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:59.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:52:59.346+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:52:59.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:52:59.907+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:00.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:00.323+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:00.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:00.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:01.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:01.288+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:01.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:01.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:02.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:02.251+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:02.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:02.895+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:03.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:03.255+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:03.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:03.917+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:04.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:04.305+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:04.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:04.911+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:05.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:05.283+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:05.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:05.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:06.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:06.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:06.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:06.969+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:07.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:07.238+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:07.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:07.940+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:08.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:08.239+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:08.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:08.938+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:09.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:09.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:09.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:09.934+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:10.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:10.212+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:10.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:10.953+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:11.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:11.196+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:11.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:11.907+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:12.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:12.152+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:12.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:12.901+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:13.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:13.172+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:13.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:13.933+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:14.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:14.203+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:14.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:14.983+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:15.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:15.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:16.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:16.024+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:16.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:16.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:17.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:17.007+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:17.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:17.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:17.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:17.968+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:18.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:18.291+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:18.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:18.941+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:19.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:19.306+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:19.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:19.989+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:20.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:20.337+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:21.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:21.007+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:21.330 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:21.329+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:21.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:21.994+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:22.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:22.343+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:23.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:23.018+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:23.386 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:23.384+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:23.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:23.983+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:24.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:24.407+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:24.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:24.969+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:25.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:25.456+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:26.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:26.011+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:26.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:26.436+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:26.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:26.990+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:27.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:27.406+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:27.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:27.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:28.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:28.430+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:28.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:28.958+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:29.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:29.466+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:29.920 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:29.919+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:30.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:30.474+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:30.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:30.905+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:31.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:31.452+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:31.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:31.943+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:32.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:32.453+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:32.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:32.985+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:33.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:33.405+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:33.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:33.997+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:34.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:34.384+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:35.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:35.047+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:35.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:35.377+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:36.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:36.089+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:36.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:36.402+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:37.104 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:37.103+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:37.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:37.402+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:38.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:38.102+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:38.396 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:38.395+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:39.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:39.080+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:39.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:39.438+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:40.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:40.048+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:40.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:40.480+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:41.031 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:41.031+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:41.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:41.522+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:42.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:42.045+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:42.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:42.546+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:43.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:43.032+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:43.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:43.515+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:44.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:44.022+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:44.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:44.492+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:44.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:44.982+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:45.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:45.463+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:46.000 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:46.000+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:46.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:46.420+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:46.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:46.982+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:47.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:47.442+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:47.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:47.977+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:48.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:48.425+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:48.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:48.971+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:49.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:49.414+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:49.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:49.929+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:50.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:50.463+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:50.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:50.973+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:51.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:51.461+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:51.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:51.926+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:52.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:52.476+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:52.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:52.927+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:53.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:53.458+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:53.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:53.929+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:54.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:54.455+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:54.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:54.917+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:55.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:55.480+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:55.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:55.963+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:56.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:56.440+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:57.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:57.003+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:57.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:57.422+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:58.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:58.023+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:58.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:58.380+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:59.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:53:59.048+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:53:59.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:53:59.411+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:00.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:00.055+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:00.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:00.447+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:01.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:01.021+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:01.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:01.405+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:02.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:02.023+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:02.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:02.411+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:03.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:03.025+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:03.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:03.445+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:04.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:04.034+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:04.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:04.441+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:05.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:05.057+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:05.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:05.455+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:06.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:06.063+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:06.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:06.459+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:07.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:07.068+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:07.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:07.437+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:08.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:08.095+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:08.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:08.443+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:09.053 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:09.052+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:09.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:09.405+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:10.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:10.063+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:10.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:10.432+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:11.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:11.089+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:11.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:11.462+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:12.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:12.058+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:12.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:12.489+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:13.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:13.077+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:13.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:13.467+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:14.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:14.043+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:14.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:14.516+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:15.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:15.003+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:15.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:15.503+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:16.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:16.007+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:16.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:16.546+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:16.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:16.978+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:17.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:17.535+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:17.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:17.945+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:18.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:18.521+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:18.973 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:18.972+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:19.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:19.539+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:19.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:19.927+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:20.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:20.523+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:20.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:20.963+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:21.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:21.514+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:22.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:22.001+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:22.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:22.492+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:22.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:22.963+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:23.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:23.472+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:24.005 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:24.005+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:24.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:24.493+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:24.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:24.992+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:25.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:25.450+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:26.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:26.038+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:26.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:26.473+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:27.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:27.003+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:27.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:27.488+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:27.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:27.966+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:28.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:28.475+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:28.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:28.968+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:29.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:29.480+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:30.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:30.001+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:30.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:30.521+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:30.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:30.991+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:31.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:31.499+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:31.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:31.965+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:32.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:32.533+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:33.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:33.008+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:33.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:33.523+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:33.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:33.965+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:34.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:34.552+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:34.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:34.932+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:35.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:35.575+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:35.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:35.959+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:36.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:36.575+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:36.987 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:36.986+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:37.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:37.528+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:37.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:37.987+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:38.561 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:38.560+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:38.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:38.981+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:39.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:39.584+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:40.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:40.015+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:40.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:40.545+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:41.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:41.037+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:41.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:41.558+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:42.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:42.002+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:42.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:42.568+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:43.033 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:43.031+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:43.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:43.565+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:44.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:44.020+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:44.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:44.522+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:44.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:44.991+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:45.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:45.557+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:45.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:45.950+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:46.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:46.567+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:46.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:46.948+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:47.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:47.533+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:47.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:47.928+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:48.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:48.562+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:48.975 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:48.974+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:49.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:49.565+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:49.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:49.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:50.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:50.523+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:50.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:50.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:51.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:51.547+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:51.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:51.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:52.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:52.535+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:52.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:52.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:53.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:53.527+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:53.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:53.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:54.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:54.482+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:54.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:54.915+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:55.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:55.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:55.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:55.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:56.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:56.474+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:56.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:56.837+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:57.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:57.505+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:57.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:57.873+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:58.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:58.498+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:58.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:58.836+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:59.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:54:59.460+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:54:59.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:54:59.796+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:00.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:00.412+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:00.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:00.766+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:01.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:01.406+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:01.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:01.773+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:02.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:02.425+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:02.799 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:02.798+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:03.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:03.474+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:03.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:03.796+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:04.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:04.430+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:04.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:04.800+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:05.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:05.478+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:05.820 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:05.819+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:06.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:06.476+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:06.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:06.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:07.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:07.498+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:07.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:07.806+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:08.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:08.455+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:08.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:08.830+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:09.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:09.425+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:09.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:09.859+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:10.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:10.414+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:10.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:10.905+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:11.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:11.380+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:11.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:11.872+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:12.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:12.350+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:12.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:12.888+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:13.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:13.383+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:13.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:13.852+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:14.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:14.399+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:14.877 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:14.877+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:15.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:15.358+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:15.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:15.845+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:16.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:16.331+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:16.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:16.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:17.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:17.349+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:17.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:17.858+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:18.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:18.382+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:18.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:18.907+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:19.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:19.423+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:19.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:19.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:20.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:20.453+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:20.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:20.858+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:21.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:21.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:21.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:21.813+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:22.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:22.500+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:22.836 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:22.834+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:23.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:23.463+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:23.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:23.871+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:24.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:24.441+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:24.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:24.869+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:25.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:25.393+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:25.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:25.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:26.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:26.394+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:26.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:26.849+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:27.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:27.390+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:27.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:27.802+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:28.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:28.349+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:28.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:28.789+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:29.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:29.344+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:29.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:29.757+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:30.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:30.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:30.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:30.801+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:31.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:31.335+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:31.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:31.762+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:32.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:32.384+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:32.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:32.751+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:33.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:33.361+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:33.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:33.750+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:34.332 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:34.331+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:34.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:34.736+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:35.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:35.313+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:35.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:35.698+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:36.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:36.349+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:36.651 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:36.649+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:37.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:37.340+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:37.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:37.670+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:38.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:38.350+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:38.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:38.677+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:39.397 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:39.396+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:39.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:39.663+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:40.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:40.363+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:40.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:40.669+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:41.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:41.391+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:41.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:41.680+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:42.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:42.371+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:42.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:42.632+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:43.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:43.406+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:43.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:43.602+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:44.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:44.453+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:44.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:44.610+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:45.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:45.468+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:45.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:45.591+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:46.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:46.492+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:46.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:46.611+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:47.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:47.481+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:47.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:47.609+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:48.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:48.478+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:48.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:48.569+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:49.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:49.498+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:49.554 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:49.553+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:50.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:50.468+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:50.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:50.596+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:51.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:51.512+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:51.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:51.622+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:52.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:52.522+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:52.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:52.610+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:53.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:53.478+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:53.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:53.578+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:54.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:54.496+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:54.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:54.602+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:55.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:55.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:55.614 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:55.614+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:56.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:56.461+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:56.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:56.592+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:57.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:57.463+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:57.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:57.642+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:58.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:58.440+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:58.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:58.684+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:59.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:55:59.460+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:55:59.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:55:59.640+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:00.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:00.432+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:00.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:00.634+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:01.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:01.414+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:01.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:01.662+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:02.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:02.427+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:02.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:02.703+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:03.379 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:03.378+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:03.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:03.715+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:04.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:04.412+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:04.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:04.740+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:05.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:05.423+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:05.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:05.726+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:06.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:06.399+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:06.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:06.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:07.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:07.359+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:07.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:07.791+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:08.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:08.313+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:08.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:08.804+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:09.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:09.285+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:09.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:09.765+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:10.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:10.304+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:10.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:10.799+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:11.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:11.309+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:11.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:11.841+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:12.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:12.306+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:12.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:12.889+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:13.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:13.353+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:13.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:13.841+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:14.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:14.350+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:14.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:14.833+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:15.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:15.314+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:15.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:15.852+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:16.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:16.282+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:16.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:16.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:17.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:17.236+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:17.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:17.911+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:18.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:18.285+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:18.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:18.938+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:19.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:19.301+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:19.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:19.898+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:20.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:20.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:20.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:20.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:21.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:21.353+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:21.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:21.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:22.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:22.313+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:22.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:22.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:23.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:23.347+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:23.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:23.898+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:24.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:24.321+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:24.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:24.852+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:25.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:25.310+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:25.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:25.843+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:26.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:26.331+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:26.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:26.871+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:27.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:27.347+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:27.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:27.900+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:28.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:28.376+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:28.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:28.856+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:29.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:29.389+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:29.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:29.820+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:30.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:30.398+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:30.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:30.833+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:31.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:31.431+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:31.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:31.821+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:32.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:32.412+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:32.829 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:32.828+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:33.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:33.434+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:33.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:33.840+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:34.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:34.470+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:34.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:34.842+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:35.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:35.514+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:35.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:35.875+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:36.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:36.478+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:36.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:36.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:37.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:37.504+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:37.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:37.885+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:38.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:38.551+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:38.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:38.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:39.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:39.571+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:39.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:39.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:40.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:40.544+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:40.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:40.926+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:41.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:41.554+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:41.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:41.923+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:42.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:42.580+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:42.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:42.969+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:43.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:43.561+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:43.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:43.931+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:44.601 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:44.600+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:44.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:44.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:45.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:45.581+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:45.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:45.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:46.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:46.592+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:46.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:46.885+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:47.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:47.593+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:47.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:47.930+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:48.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:48.583+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:48.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:48.938+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:49.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:49.552+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:49.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:49.907+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:50.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:50.515+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:50.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:50.907+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:51.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:51.479+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:51.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:51.928+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:52.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:52.510+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:52.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:52.933+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:53.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:53.518+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:53.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:53.899+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:54.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:54.486+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:54.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:54.949+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:55.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:55.482+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:55.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:55.953+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:56.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:56.513+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:56.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:56.965+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:57.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:57.509+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:57.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:57.984+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:58.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:58.529+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:58.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:58.987+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:59.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:56:59.533+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:56:59.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:56:59.952+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:00.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:00.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:00.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:00.941+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:01.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:01.442+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:01.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:01.894+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:02.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:02.487+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:02.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:02.864+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:03.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:03.529+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:03.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:03.848+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:04.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:04.573+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:04.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:04.838+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:05.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:05.554+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:05.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:05.857+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:06.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:06.584+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:06.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:06.867+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:07.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:07.591+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:07.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:07.846+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:08.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:08.563+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:08.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:08.876+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:09.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:09.579+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:09.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:09.836+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:10.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:10.539+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:10.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:10.827+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:11.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:11.521+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:11.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:11.817+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:12.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:12.499+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:12.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:12.804+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:13.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:13.536+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:13.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:13.808+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:14.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:14.565+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:14.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:14.775+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:15.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:15.574+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:15.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:15.743+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:16.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:16.548+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:16.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:16.741+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:17.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:17.576+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:17.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:17.694+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:18.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:18.594+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:18.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:18.734+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:19.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:19.556+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:19.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:19.714+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:20.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:20.522+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:20.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:20.676+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:21.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:21.565+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:21.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:21.696+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:22.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:22.603+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:22.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:22.696+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:23.649 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:23.649+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:23.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:23.719+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:24.610 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:24.610+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:24.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:24.736+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:25.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:25.566+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:25.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:25.712+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:26.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:26.520+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:26.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:26.706+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:27.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:27.514+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:27.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:27.703+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:28.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:28.562+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:28.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:28.683+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:29.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:29.518+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:29.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:29.695+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:30.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:30.539+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:30.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:30.715+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:31.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:31.528+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:31.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:31.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:32.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:32.554+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:32.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:32.747+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:33.561 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:33.559+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:33.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:33.770+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:34.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:34.559+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:34.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:34.731+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:35.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:35.564+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:35.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:35.715+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:36.597 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:36.596+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:36.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:36.744+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:37.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:37.598+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:37.738 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:37.736+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:38.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:38.580+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:38.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:38.775+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:39.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:39.588+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:39.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:39.777+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:40.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:40.544+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:40.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:40.771+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:41.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:41.536+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:41.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:41.726+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:42.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:42.561+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:42.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:42.680+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:43.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:43.532+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:43.639 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:43.638+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:44.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:44.534+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:44.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:44.676+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:45.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:45.574+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:45.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:45.697+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:46.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:46.619+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:46.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:46.727+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:47.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:47.604+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:47.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:47.744+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:48.586 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:48.585+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:48.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:48.717+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:49.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:49.553+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:49.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:49.744+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:50.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:50.574+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:50.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:50.711+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:51.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:51.527+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:51.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:51.698+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:52.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:52.574+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:52.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:52.742+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:53.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:53.567+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:53.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:53.710+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:54.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:54.575+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:54.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:54.727+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:55.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:55.550+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:55.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:55.697+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:56.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:56.531+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:56.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:56.661+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:57.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:57.556+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:57.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:57.639+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:58.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:58.563+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:58.624 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:58.623+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:59.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:57:59.549+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:57:59.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:57:59.626+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:00.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:00.545+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:00.583 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:00.582+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:01.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:01.531+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:01.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:01.556+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:02.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:02.542+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:02.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:02.560+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:03.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:03.538+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:03.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:03.560+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:04.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:04.526+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:04.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:04.555+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:05.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:05.542+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:05.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:05.571+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:06.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:06.531+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:06.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:06.620+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:07.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:07.579+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:07.609 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:07.609+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:08.561 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:08.560+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:08.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:08.643+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:09.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:09.556+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:09.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:09.621+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:10.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:10.559+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:10.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:10.637+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:11.599 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:11.599+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:11.630 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:11.630+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:12.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:12.620+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:12.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:12.646+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:13.614 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:13.614+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:13.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:13.646+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:14.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:14.602+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:14.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:14.623+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:15.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:15.559+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:15.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:15.578+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:16.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:16.567+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:16.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:16.610+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:17.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:17.548+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:17.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:17.590+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:18.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:18.547+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:18.576 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:18.574+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:19.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:19.538+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:19.554 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:19.553+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:20.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:20.500+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:20.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:20.572+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:21.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:21.496+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:21.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:21.536+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:22.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:22.496+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:22.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:22.586+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:23.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:23.504+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:23.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:23.622+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:24.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:24.496+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:24.658 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:24.657+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:25.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:25.449+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:25.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:25.611+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:26.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:26.423+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:26.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:26.605+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:27.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:27.455+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:27.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:27.633+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:28.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:28.495+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:28.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:28.674+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:29.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:29.489+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:29.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:29.707+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:30.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:30.515+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:30.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:30.681+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:31.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:31.482+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:31.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:31.698+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:32.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:32.485+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:32.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:32.708+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:33.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:33.453+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:33.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:33.741+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:34.409 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:34.408+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:34.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:34.765+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:35.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:35.439+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:35.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:35.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:36.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:36.442+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:36.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:36.784+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:37.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:37.488+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:37.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:37.819+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:38.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:38.492+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:38.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:38.771+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:39.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:39.531+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:39.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:39.730+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:40.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:40.524+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:40.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:40.682+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:41.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:41.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:41.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:41.673+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:42.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:42.504+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:42.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:42.711+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:43.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:43.460+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:43.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:43.703+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:44.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:44.509+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:44.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:44.716+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:45.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:45.482+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:45.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:45.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:46.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:46.494+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:46.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:46.745+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:47.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:47.532+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:47.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:47.767+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:48.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:48.555+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:48.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:48.816+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:49.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:49.605+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:49.783 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:49.782+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:50.632 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:50.632+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:50.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:50.754+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:51.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:51.624+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:51.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:51.717+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:52.599 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:52.599+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:52.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:52.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:53.632 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:53.632+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:53.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:53.802+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:54.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:54.651+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:54.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:54.807+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:55.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:55.637+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:55.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:55.769+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:56.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:56.619+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:56.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:56.784+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:57.611 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:57.611+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:57.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:57.750+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:58.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:58.640+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:58.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:58.792+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:59.632 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:58:59.631+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:58:59.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:58:59.834+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:00.665 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:00.664+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:00.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:00.817+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:01.676 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:01.674+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:01.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:01.830+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:02.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:02.723+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:02.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:02.786+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:03.713 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:03.712+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:03.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:03.780+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:04.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:04.705+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:04.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:04.776+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:05.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:05.751+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:05.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:05.780+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:06.707 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:06.706+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:06.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:06.784+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:07.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:07.730+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:07.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:07.818+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:08.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:08.693+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:08.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:08.808+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:09.678 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:09.677+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:09.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:09.787+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:10.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:10.647+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:10.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:10.836+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:11.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:11.694+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:11.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:11.848+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:12.741 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:12.739+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:12.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:12.851+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:13.750 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:13.749+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:13.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:13.851+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:14.738 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:14.737+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:14.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:14.811+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:15.752 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:15.751+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:15.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:15.807+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:16.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:16.744+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:16.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:16.813+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:17.738 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:17.737+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:17.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:17.831+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:18.732 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:18.731+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:18.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:18.856+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:19.707 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:19.706+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:19.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:19.861+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:20.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:20.696+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:20.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:20.817+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:21.681 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:21.680+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:21.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:21.831+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:22.720 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:22.719+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:22.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:22.808+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:23.726 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:23.724+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:23.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:23.781+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:24.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:24.695+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:24.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:24.823+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:25.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:25.679+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:25.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:25.845+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:26.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:26.644+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:26.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:26.802+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:27.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:27.690+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:27.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:27.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:28.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:28.671+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:28.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:28.832+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:29.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:29.708+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:29.879 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:29.877+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:30.718 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:30.718+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:30.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:30.911+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:31.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:31.672+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:31.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:31.915+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:32.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:32.673+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:32.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:32.929+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:33.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:33.692+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:33.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:33.969+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:34.687 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:34.686+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:35.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:35.001+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:35.702 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:35.702+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:35.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:35.989+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:36.746 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:36.746+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:36.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:36.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:37.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:37.777+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:37.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:37.913+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:38.789 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:38.789+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:38.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:38.941+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:39.746 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:39.746+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:39.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:39.894+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:40.795 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:40.795+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:40.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:40.904+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:41.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:41.760+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:41.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:41.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:42.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:42.789+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:42.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:42.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:43.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:43.805+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:43.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:43.868+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:44.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:44.767+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:44.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:44.845+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:45.797 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:45.796+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:45.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:45.802+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:46.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:46.777+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:46.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:46.810+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:47.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:47.804+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:47.811 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:47.809+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:48.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:48.761+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:48.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:48.776+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:49.729 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:49.728+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:49.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:49.760+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:50.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:50.700+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:50.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:50.748+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:51.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:51.665+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:51.720 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:51.719+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:52.667 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:52.666+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:52.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:52.703+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:53.667 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:53.666+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:53.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:53.734+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:54.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:54.700+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:54.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:54.705+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:55.654 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:55.652+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:55.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:55.740+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:56.604 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:56.603+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:56.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:56.711+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:57.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:57.644+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:57.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:57.729+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:58.677 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:58.676+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:58.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:58.740+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:59.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T04:59:59.690+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T04:59:59.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T04:59:59.774+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:00.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:00.700+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:00.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:00.778+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:01.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:01.679+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:01.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:01.778+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:02.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:02.645+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:02.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:02.740+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:03.688 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:03.687+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:03.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:03.759+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:04.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:04.699+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:04.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:04.795+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:05.653 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:05.652+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:05.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:05.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:06.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:06.678+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:06.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:06.764+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:07.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:07.636+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:07.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:07.736+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:08.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:08.623+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:08.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:08.694+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:09.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:09.576+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:09.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:09.728+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:10.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:10.565+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:10.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:10.718+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:11.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:11.533+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:11.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:11.708+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:12.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:12.520+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:12.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:12.715+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:13.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:13.506+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:13.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:13.760+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:14.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:14.544+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:14.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:14.798+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:15.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:15.526+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:15.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:15.780+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:16.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:16.555+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:16.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:16.793+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:17.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:17.534+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:17.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:17.779+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:18.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:18.578+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:18.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:18.752+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:19.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:19.598+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:19.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:19.742+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:20.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:20.570+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:20.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:20.749+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:21.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:21.563+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:21.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:21.719+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:22.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:22.515+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:22.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:22.763+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:23.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:23.495+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:23.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:23.741+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:24.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:24.458+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:24.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:24.735+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:25.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:25.479+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:25.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:25.782+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:26.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:26.456+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:26.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:26.788+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:27.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:27.504+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:27.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:27.837+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:28.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:28.476+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:28.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:28.857+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:29.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:29.440+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:29.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:29.868+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:30.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:30.472+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:30.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:30.893+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:31.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:31.471+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:31.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:31.886+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:32.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:32.520+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:32.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:32.901+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:33.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:33.554+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:33.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:33.874+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:34.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:34.584+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:34.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:34.872+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:35.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:35.581+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:35.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:35.891+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:36.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:36.539+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:36.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:36.864+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:37.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:37.526+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:37.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:37.864+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:38.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:38.528+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:38.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:38.871+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:39.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:39.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:39.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:39.840+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:40.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:40.462+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:40.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:40.808+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:41.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:41.438+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:41.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:41.801+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:42.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:42.472+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:42.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:42.770+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:43.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:43.490+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:43.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:43.801+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:44.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:44.475+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:44.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:44.799+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:45.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:45.475+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:45.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:45.815+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:46.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:46.510+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:46.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:46.772+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:47.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:47.464+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:47.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:47.729+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:48.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:48.446+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:48.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:48.722+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:49.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:49.478+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:49.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:49.677+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:50.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:50.512+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:50.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:50.720+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:51.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:51.500+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:51.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:51.729+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:52.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:52.469+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:52.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:52.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:53.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:53.430+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:53.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:53.770+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:54.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:54.428+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:54.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:54.722+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:55.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:55.432+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:55.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:55.705+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:56.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:56.483+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:56.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:56.699+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:57.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:57.504+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:57.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:57.683+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:58.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:58.489+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:58.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:58.726+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:59.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:00:59.528+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:00:59.740 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:00:59.740+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:00.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:00.531+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:00.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:00.767+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:01.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:01.503+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:01.738 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:01.738+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:02.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:02.495+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:02.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:02.779+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:03.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:03.506+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:03.829 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:03.829+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:04.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:04.520+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:04.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:04.802+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:05.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:05.570+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:05.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:05.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:06.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:06.544+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:06.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:06.710+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:07.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:07.577+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:07.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:07.723+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:08.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:08.567+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:08.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:08.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:09.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:09.605+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:09.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:09.778+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:10.639 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:10.638+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:10.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:10.746+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:11.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:11.663+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:11.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:11.721+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:12.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:12.671+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:12.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:12.722+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:13.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:13.678+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:13.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:13.759+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:14.677 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:14.676+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:14.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:14.794+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:15.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:15.635+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:15.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:15.833+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:16.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:16.659+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:16.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:16.831+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:17.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:17.619+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:17.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:17.873+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:18.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:18.658+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:18.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:18.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:19.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:19.646+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:19.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:19.854+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:20.684 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:20.682+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:20.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:20.898+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:21.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:21.635+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:21.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:21.880+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:22.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:22.601+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:22.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:22.927+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:23.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:23.588+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:23.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:23.915+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:24.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:24.542+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:24.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:24.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:25.586 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:25.585+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:25.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:25.876+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:26.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:26.598+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:26.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:26.889+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:27.612 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:27.610+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:27.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:27.930+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:28.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:28.569+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:28.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:28.898+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:29.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:29.589+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:29.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:29.875+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:30.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:30.607+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:30.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:30.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:31.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:31.601+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:31.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:31.917+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:32.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:32.651+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:32.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:32.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:33.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:33.650+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:33.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:33.952+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:34.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:34.641+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:34.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:34.922+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:35.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:35.612+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:35.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:35.886+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:36.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:36.578+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:36.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:36.869+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:37.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:37.539+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:37.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:37.889+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:38.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:38.523+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:38.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:38.852+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:39.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:39.483+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:39.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:39.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:40.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:40.442+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:40.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:40.815+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:41.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:41.393+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:41.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:41.786+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:42.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:42.406+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:42.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:42.756+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:43.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:43.365+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:43.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:43.803+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:44.321 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:44.321+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:44.854 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:44.853+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:45.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:45.279+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:45.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:45.885+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:46.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:46.287+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:46.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:46.917+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:47.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:47.314+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:47.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:47.893+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:48.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:48.305+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:48.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:48.849+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:49.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:49.347+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:49.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:49.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:50.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:50.361+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:50.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:50.848+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:51.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:51.329+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:51.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:51.848+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:52.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:52.342+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:52.811 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:52.811+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:53.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:53.353+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:53.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:53.829+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:54.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:54.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:54.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:54.795+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:55.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:55.307+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:55.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:55.841+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:56.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:56.284+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:56.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:56.818+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:57.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:57.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:57.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:57.803+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:58.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:58.216+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:58.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:58.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:59.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:01:59.193+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:01:59.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:01:59.760+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:00.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:00.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:00.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:00.770+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:01.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:01.202+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:01.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:01.800+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:02.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:02.211+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:02.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:02.783+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:03.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:03.211+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:03.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:03.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:04.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:04.216+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:04.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:04.750+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:05.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:05.252+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:05.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:05.709+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:06.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:06.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:06.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:06.695+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:07.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:07.202+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:07.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:07.658+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:08.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:08.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:08.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:08.660+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:09.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:09.270+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:09.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:09.695+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:10.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:10.264+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:10.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:10.648+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:11.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:11.269+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:11.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:11.676+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:12.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:12.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:12.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:12.648+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:13.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:13.209+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:13.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:13.680+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:14.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:14.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:14.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:14.712+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:15.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:15.219+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:15.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:15.670+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:16.242 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:16.241+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:16.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:16.685+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:17.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:17.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:17.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:17.669+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:18.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:18.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:18.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:18.627+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:19.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:19.233+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:19.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:19.590+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:20.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:20.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:20.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:20.578+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:21.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:21.250+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:21.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:21.548+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:22.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:22.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:22.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:22.588+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:23.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:23.227+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:23.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:23.634+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:24.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:24.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:24.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:24.679+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:25.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:25.232+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:25.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:25.653+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:26.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:26.199+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:26.639 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:26.639+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:27.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:27.175+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:27.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:27.635+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:28.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:28.131+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:28.605 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:28.605+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:29.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:29.118+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:29.601 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:29.601+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:30.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:30.136+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:30.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:30.613+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:31.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:31.185+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:31.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:31.629+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:32.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:32.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:32.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:32.613+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:33.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:33.190+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:33.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:33.586+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:34.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:34.208+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:34.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:34.589+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:35.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:35.238+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:35.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:35.542+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:36.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:36.244+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:36.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:36.496+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:37.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:37.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:37.526 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:37.525+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:38.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:38.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:38.576 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:38.575+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:39.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:39.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:39.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:39.579+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:40.246 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:40.245+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:40.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:40.555+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:41.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:41.219+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:41.536 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:41.535+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:42.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:42.191+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:42.498 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:42.497+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:43.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:43.221+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:43.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:43.493+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:44.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:44.269+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:44.491 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:44.490+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:45.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:45.285+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:45.465 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:45.464+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:46.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:46.270+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:46.498 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:46.497+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:47.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:47.262+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:47.448 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:47.447+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:48.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:48.220+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:48.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:48.491+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:49.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:49.189+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:49.466 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:49.465+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:50.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:50.168+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:50.424 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:50.423+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:51.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:51.207+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:51.395 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:51.394+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:52.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:52.221+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:52.434 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:52.433+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:53.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:53.210+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:53.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:53.390+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:54.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:54.189+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:54.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:54.392+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:55.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:55.183+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:55.435 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:55.434+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:56.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:56.203+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:56.466 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:56.465+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:57.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:57.185+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:57.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:57.495+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:58.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:58.206+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:58.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:58.481+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:59.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:02:59.181+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:02:59.519 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:02:59.518+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:00.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:00.145+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:00.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:00.531+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:01.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:01.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:01.501 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:01.499+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:02.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:02.111+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:02.527 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:02.526+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:03.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:03.125+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:03.505 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:03.503+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:04.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:04.159+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:04.511 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:04.510+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:05.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:05.179+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:05.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:05.530+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:06.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:06.229+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:06.553 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:06.552+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:07.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:07.213+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:07.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:07.567+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:08.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:08.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:08.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:08.536+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:09.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:09.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:09.524 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:09.523+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:10.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:10.224+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:10.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:10.572+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:11.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:11.211+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:11.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:11.599+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:12.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:12.252+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:12.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:12.649+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:13.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:13.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:13.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:13.634+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:14.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:14.280+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:14.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:14.632+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:15.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:15.248+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:15.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:15.595+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:16.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:16.229+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:16.607 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:16.607+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:17.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:17.235+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:17.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:17.623+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:18.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:18.258+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:18.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:18.629+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:19.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:19.301+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:19.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:19.647+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:20.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:20.330+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:20.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:20.602+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:21.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:21.322+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:21.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:21.574+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:22.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:22.284+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:22.536 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:22.535+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:23.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:23.330+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:23.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:23.567+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:24.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:24.340+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:24.525 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:24.524+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:25.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:25.373+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:25.513 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:25.512+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:26.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:26.364+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:26.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:26.493+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:27.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:27.401+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:27.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:27.456+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:28.355 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:28.354+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:28.410 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:28.409+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:29.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:29.314+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:29.414 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:29.413+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:30.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:30.291+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:30.463 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:30.462+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:31.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:31.332+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:31.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:31.459+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:32.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:32.342+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:32.495 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:32.494+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:33.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:33.344+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:33.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:33.528+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:34.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:34.392+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:34.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:34.529+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:35.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:35.369+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:35.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:35.568+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:36.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:36.340+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:36.527 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:36.526+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:37.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:37.371+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:37.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:37.541+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:38.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:38.406+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:38.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:38.546+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:39.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:39.369+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:39.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:39.539+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:40.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:40.382+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:40.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:40.586+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:41.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:41.374+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:41.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:41.631+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:42.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:42.424+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:42.601 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:42.600+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:43.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:43.392+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:43.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:43.566+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:44.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:44.391+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:44.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:44.601+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:45.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:45.422+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:45.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:45.644+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:46.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:46.464+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:46.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:46.687+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:47.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:47.446+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:47.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:47.728+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:48.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:48.397+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:48.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:48.760+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:49.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:49.376+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:49.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:49.718+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:50.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:50.346+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:50.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:50.690+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:51.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:51.339+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:51.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:51.694+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:52.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:52.309+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:52.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:52.730+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:53.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:53.293+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:53.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:53.708+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:54.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:54.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:54.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:54.703+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:55.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:55.279+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:55.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:55.678+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:56.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:56.310+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:56.701 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:56.701+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:57.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:57.273+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:57.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:57.731+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:58.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:58.310+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:58.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:58.737+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:59.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:03:59.267+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:03:59.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:03:59.715+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:00.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:00.299+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:00.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:00.732+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:01.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:01.302+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:01.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:01.683+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:02.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:02.351+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:02.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:02.655+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:03.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:03.367+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:03.657 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:03.657+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:04.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:04.389+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:04.615 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:04.615+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:05.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:05.374+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:05.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:05.567+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:06.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:06.398+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:06.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:06.556+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:07.421 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:07.420+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:07.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:07.572+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:08.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:08.434+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:08.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:08.573+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:09.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:09.389+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:09.621 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:09.620+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:10.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:10.400+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:10.630 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:10.629+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:11.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:11.424+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:11.630 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:11.629+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:12.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:12.418+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:12.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:12.624+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:13.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:13.392+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:13.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:13.588+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:14.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:14.440+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:14.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:14.578+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:15.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:15.437+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:15.558 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:15.557+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:16.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:16.426+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:16.563 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:16.562+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:17.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:17.417+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:17.605 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:17.604+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:18.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:18.394+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:18.639 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:18.638+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:19.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:19.419+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:19.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:19.628+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:20.382 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:20.381+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:20.654 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:20.653+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:21.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:21.402+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:21.658 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:21.657+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:22.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:22.432+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:22.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:22.621+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:23.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:23.397+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:23.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:23.671+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:24.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:24.349+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:24.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:24.694+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:25.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:25.326+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:25.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:25.701+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:26.332 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:26.330+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:26.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:26.712+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:27.379 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:27.378+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:27.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:27.754+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:28.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:28.349+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:28.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:28.737+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:29.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:29.363+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:29.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:29.757+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:30.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:30.369+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:30.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:30.767+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:31.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:31.410+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:31.720 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:31.719+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:32.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:32.426+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:32.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:32.682+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:33.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:33.447+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:33.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:33.724+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:34.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:34.484+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:34.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:34.744+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:35.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:35.460+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:35.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:35.785+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:36.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:36.500+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:36.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:36.762+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:37.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:37.461+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:37.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:37.757+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:38.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:38.482+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:38.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:38.731+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:39.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:39.532+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:39.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:39.683+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:40.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:40.512+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:40.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:40.637+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:41.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:41.560+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:41.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:41.618+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:42.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:42.582+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:42.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:42.593+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:43.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:43.580+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:43.612 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:43.612+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:44.554 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:44.554+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:44.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:44.655+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:45.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:45.579+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:45.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:45.691+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:46.608 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:46.608+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:46.707 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:46.707+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:47.583 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:47.582+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:47.690 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:47.690+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:48.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:48.617+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:48.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:48.695+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:49.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:49.652+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:49.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:49.658+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:50.682 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:50.681+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:50.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:50.702+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:51.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:51.665+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:51.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:51.710+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:52.700 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:52.698+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:52.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:52.725+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:53.657 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:53.656+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:53.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:53.749+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:54.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:54.695+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:54.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:54.786+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:55.732 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:55.731+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:55.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:55.789+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:56.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:56.724+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:56.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:56.811+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:57.740 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:57.739+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:57.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:57.802+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:58.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:58.764+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:58.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:58.847+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:59.747 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:04:59.746+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:04:59.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:04:59.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:00.734 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:00.733+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:00.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:00.917+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:01.763 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:01.762+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:01.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:01.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:02.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:02.804+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:02.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:02.930+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:03.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:03.761+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:03.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:03.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:04.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:04.761+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:04.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:04.920+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:05.750 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:05.749+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:05.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:05.909+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:06.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:06.777+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:06.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:06.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:07.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:07.757+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:07.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:07.895+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:08.786 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:08.785+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:08.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:08.920+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:09.789 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:09.788+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:09.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:09.954+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:10.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:10.757+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:10.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:10.958+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:11.737 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:11.736+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:11.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:11.949+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:12.754 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:12.753+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:12.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:12.923+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:13.734 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:13.733+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:13.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:13.967+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:14.712 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:14.711+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:14.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:14.937+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:15.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:15.759+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:15.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:15.926+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:16.761 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:16.760+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:16.879 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:16.878+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:17.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:17.738+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:17.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:17.892+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:18.732 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:18.731+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:18.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:18.861+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:19.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:19.748+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:19.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:19.858+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:20.734 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:20.734+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:20.895 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:20.895+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:21.782 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:21.782+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:21.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:21.861+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:22.816 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:22.816+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:22.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:22.832+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:23.784 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:23.783+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:23.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:23.856+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:24.771 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:24.771+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:24.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:24.871+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:25.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:25.798+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:25.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:25.864+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:26.776 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:26.776+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:26.820 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:26.820+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:27.808 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:27.808+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:27.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:27.833+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:28.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:28.760+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:28.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:28.884+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:29.788 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:29.788+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:29.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:29.878+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:30.773 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:30.773+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:30.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:30.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:31.796 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:31.796+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:31.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:31.861+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:32.790 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:32.789+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:32.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:32.825+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:33.833 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:33.832+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:33.866 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:33.865+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:34.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:34.822+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:34.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:34.879+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:35.791 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:35.790+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:35.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:35.901+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:36.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:36.784+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:36.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:36.894+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:37.829 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:37.828+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:37.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:37.861+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:38.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:38.832+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:38.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:38.895+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:39.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:39.784+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:39.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:39.889+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:40.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:40.745+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:40.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:40.887+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:41.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:41.718+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:41.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:41.873+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:42.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:42.708+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:42.873 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:42.872+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:43.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:43.722+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:43.913 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:43.912+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:44.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:44.688+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:44.915 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:44.914+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:45.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:45.689+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:45.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:45.882+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:46.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:46.705+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:46.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:46.926+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:47.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:47.692+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:47.892 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:47.891+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:48.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:48.735+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:48.857 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:48.856+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:49.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:49.703+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:49.878 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:49.877+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:50.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:50.699+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:50.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:50.885+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:51.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:51.678+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:51.898 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:51.897+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:52.654 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:52.652+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:52.854 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:52.852+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:53.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:53.695+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:53.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:53.885+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:54.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:54.660+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:54.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:54.930+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:55.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:55.685+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:55.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:55.889+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:56.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:56.662+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:56.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:56.876+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:57.641 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:57.640+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:57.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:57.831+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:58.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:58.639+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:58.876 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:58.875+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:59.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:05:59.654+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:05:59.856 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:05:59.855+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:00.663 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:00.662+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:00.818 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:00.817+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:01.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:01.688+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:01.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:01.847+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:02.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:02.666+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:02.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:02.861+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:03.707 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:03.706+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:03.857 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:03.857+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:04.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:04.713+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:04.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:04.866+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:05.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:05.723+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:05.835 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:05.835+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:06.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:06.700+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:06.861 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:06.861+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:07.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:07.717+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:07.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:07.863+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:08.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:08.667+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:08.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:08.858+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:09.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:09.697+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:09.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:09.896+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:10.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:10.718+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:10.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:10.862+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:11.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:11.725+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:11.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:11.862+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:12.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:12.742+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:12.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:12.827+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:13.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:13.769+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:13.875 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:13.875+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:14.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:14.739+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:14.891 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:14.891+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:15.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:15.748+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:15.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:15.883+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:16.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:16.702+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:16.847 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:16.846+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:17.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:17.678+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:17.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:17.831+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:18.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:18.677+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:18.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:18.832+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:19.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:19.658+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:19.876 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:19.875+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:20.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:20.686+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:20.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:20.882+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:21.688 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:21.687+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:21.887 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:21.885+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:22.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:22.736+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:22.926 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:22.924+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:23.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:23.756+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:23.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:23.913+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:24.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:24.713+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:24.868 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:24.867+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:25.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:25.667+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:25.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:25.894+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:26.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:26.625+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:26.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:26.938+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:27.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:27.576+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:27.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:27.966+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:28.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:28.548+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:28.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:28.953+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:29.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:29.584+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:30.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:30.002+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:30.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:30.591+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:30.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:30.968+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:31.547 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:31.546+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:31.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:31.986+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:32.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:32.574+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:32.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:32.968+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:33.615 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:33.614+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:33.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:33.972+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:34.621 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:34.620+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:34.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:34.990+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:35.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:35.580+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:35.965 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:35.964+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:36.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:36.597+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:36.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:36.954+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:37.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:37.572+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:37.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:37.984+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:38.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:38.554+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:39.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:39.000+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:39.583 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:39.582+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:39.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:39.975+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:40.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:40.586+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:40.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:40.944+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:41.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:41.550+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:41.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:41.990+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:42.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:42.521+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:42.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:42.948+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:43.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:43.542+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:43.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:43.958+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:44.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:44.580+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:44.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:44.966+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:45.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:45.572+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:45.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:45.922+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:46.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:46.579+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:46.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:46.921+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:47.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:47.605+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:47.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:47.955+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:48.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:48.570+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:48.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:48.930+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:49.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:49.540+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:49.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:49.927+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:50.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:50.590+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:50.921 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:50.921+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:51.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:51.618+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:51.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:51.884+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:52.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:52.572+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:52.899 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:52.899+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:53.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:53.554+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:53.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:53.900+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:54.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:54.573+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:54.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:54.895+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:55.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:55.549+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:55.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:55.874+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:56.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:56.585+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:56.917 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:56.917+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:57.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:57.594+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:57.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:57.934+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:58.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:58.568+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:58.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:58.970+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:59.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:06:59.568+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:06:59.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:06:59.963+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:00.553 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:00.552+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:00.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:00.949+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:01.509 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:01.508+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:01.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:01.963+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:02.468 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:02.467+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:02.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:02.996+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:03.466 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:03.464+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:03.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:03.954+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:04.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:04.505+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:04.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:04.998+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:05.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:05.495+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:05.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:05.997+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:06.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:06.531+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:06.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:06.991+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:07.538 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:07.536+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:07.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:07.959+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:08.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:08.573+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:08.918 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:08.917+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:09.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:09.554+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:09.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:09.935+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:10.554 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:10.552+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:10.972 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:10.971+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:11.600 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:11.599+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:11.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:11.977+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:12.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:12.625+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:12.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:12.972+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:13.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:13.639+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:13.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:13.980+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:14.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:14.595+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:14.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:14.968+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:15.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:15.630+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:15.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:15.977+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:16.641 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:16.640+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:16.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:16.983+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:17.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:17.676+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:17.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:17.934+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:18.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:18.699+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:18.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:18.887+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:19.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:19.732+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:19.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:19.889+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:20.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:20.778+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:20.857 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:20.856+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:21.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:21.825+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:21.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:21.901+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:22.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:22.854+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:22.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:22.937+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:23.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:23.843+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:23.892 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:23.891+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:24.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:24.808+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:24.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:24.847+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:25.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:25.842+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:25.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:25.857+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:26.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:26.850+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:26.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:26.857+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:27.865 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:27.864+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:27.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:27.864+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:28.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:28.847+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:28.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:28.855+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:29.811 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:29.809+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:29.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:29.832+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:30.811 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:30.810+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:30.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:30.846+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:31.792 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:31.792+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:31.799 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:31.799+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:32.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:32.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:32.841 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:32.841+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:33.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:33.715+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:33.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:33.858+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:34.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:34.754+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:34.845 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:34.845+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:35.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:35.709+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:35.861 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:35.861+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:36.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:36.664+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:36.821 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:36.821+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:37.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:37.684+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:37.853 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:37.852+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:38.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:38.723+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:38.828 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:38.828+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:39.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:39.692+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:39.850 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:39.846+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:40.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:40.722+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:40.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:40.815+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:41.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:41.695+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:41.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:41.823+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:42.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:42.722+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:42.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:42.853+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:43.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:43.690+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:43.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:43.806+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:44.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:44.658+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:44.835 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:44.834+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:45.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:45.688+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:45.881 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:45.880+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:46.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:46.672+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:46.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:46.918+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:47.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:47.714+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:47.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:47.928+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:48.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:48.751+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:48.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:48.968+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:49.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:49.754+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:50.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:50.006+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:50.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:50.714+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:51.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:51.018+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:51.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:51.745+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:51.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:51.988+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:52.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:52.760+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:53.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:53.010+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:53.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:53.726+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:54.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:54.037+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:54.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:54.701+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:55.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:55.085+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:55.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:55.659+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:56.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:56.110+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:56.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:56.635+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:57.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:57.139+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:57.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:57.658+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:58.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:58.129+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:58.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:58.681+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:59.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:07:59.152+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:07:59.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:07:59.666+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:00.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:00.138+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:00.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:00.698+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:01.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:01.106+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:01.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:01.743+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:02.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:02.061+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:02.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:02.762+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:03.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:03.093+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:03.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:03.805+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:04.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:04.097+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:04.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:04.842+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:05.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:05.068+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:05.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:05.836+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:06.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:06.022+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:06.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:06.846+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:07.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:07.046+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:07.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:07.868+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:08.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:08.005+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:08.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:08.882+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:08.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:08.956+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:09.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:09.880+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:09.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:09.949+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:10.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:10.895+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:10.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:10.950+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:11.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:11.933+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:11.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:11.942+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:12.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:12.926+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:12.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:12.936+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:13.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:13.899+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:13.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:13.961+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:14.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:14.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:15.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:15.004+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:15.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:15.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:15.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:15.993+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:16.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:16.922+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:16.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:16.982+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:17.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:17.898+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:18.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:18.020+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:18.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:18.874+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:19.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:19.009+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:19.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:19.853+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:20.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:20.022+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:20.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:20.832+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:20.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:20.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:21.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:21.821+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:21.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:21.989+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:22.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:22.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:23.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:23.015+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:23.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:23.827+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:24.041 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:24.041+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:24.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:24.807+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:25.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:25.020+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:25.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:25.800+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:26.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:26.028+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:26.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:26.838+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:27.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:27.053+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:27.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:27.816+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:28.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:28.018+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:28.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:28.805+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:28.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:28.970+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:29.799 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:29.798+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:30.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:30.002+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:30.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:30.802+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:31.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:31.023+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:31.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:31.788+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:32.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:32.016+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:32.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:32.743+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:33.066 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:33.065+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:33.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:33.772+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:34.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:34.045+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:34.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:34.820+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:35.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:35.077+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:35.866 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:35.865+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:36.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:36.121+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:36.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:36.816+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:37.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:37.161+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:37.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:37.800+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:38.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:38.127+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:38.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:38.788+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:39.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:39.099+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:39.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:39.784+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:40.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:40.135+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:40.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:40.808+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:41.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:41.117+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:41.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:41.844+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:42.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:42.094+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:42.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:42.861+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:43.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:43.113+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:43.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:43.847+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:44.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:44.127+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:44.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:44.877+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:45.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:45.112+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:45.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:45.880+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:46.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:46.149+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:46.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:46.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:47.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:47.107+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:47.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:47.917+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:48.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:48.092+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:48.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:48.877+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:49.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:49.053+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:49.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:49.879+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:50.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:50.056+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:50.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:50.845+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:51.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:51.049+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:51.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:51.847+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:52.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:52.030+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:52.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:52.812+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:53.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:53.081+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:53.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:53.849+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:54.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:54.067+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:54.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:54.850+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:55.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:55.022+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:55.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:55.889+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:55.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:55.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:56.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:56.843+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:56.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:56.984+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:57.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:57.867+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:57.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:57.942+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:58.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:58.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:58.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:58.944+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:59.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:08:59.927+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:08:59.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:08:59.977+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:00.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:00.943+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:00.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:00.995+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:01.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:01.963+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:02.041 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:02.041+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:02.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:02.933+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:03.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:03.086+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:03.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:03.946+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:04.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:04.106+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:04.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:04.910+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:05.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:05.080+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:05.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:05.951+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:06.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:06.037+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:06.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:06.997+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:07.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:07.064+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:07.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:07.968+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:08.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:08.096+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:09.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:09.015+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:09.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:09.068+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:09.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:09.990+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:10.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:10.019+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:10.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:10.940+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:11.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:11.058+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:11.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:11.926+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:12.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:12.062+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:12.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:12.917+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:13.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:13.112+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:13.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:13.872+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:14.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:14.109+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:14.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:14.893+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:15.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:15.100+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:15.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:15.933+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:16.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:16.086+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:16.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:16.949+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:17.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:17.090+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:17.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:17.908+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:18.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:18.080+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:18.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:18.953+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:19.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:19.088+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:19.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:19.915+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:20.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:20.112+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:20.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:20.955+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:21.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:21.114+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:21.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:21.934+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:22.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:22.130+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:22.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:22.952+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:23.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:23.171+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:23.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:23.996+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:24.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:24.134+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:25.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:25.017+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:25.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:25.175+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:26.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:26.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:26.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:26.169+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:27.031 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:27.030+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:27.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:27.184+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:28.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:28.006+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:28.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:28.199+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:29.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:29.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:29.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:29.170+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:30.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:30.019+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:30.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:30.142+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:30.987 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:30.986+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:31.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:31.171+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:31.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:31.938+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:32.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:32.138+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:32.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:32.898+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:33.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:33.188+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:33.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:33.920+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:34.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:34.159+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:34.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:34.941+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:35.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:35.178+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:35.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:35.906+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:36.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:36.139+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:36.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:36.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:37.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:37.182+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:37.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:37.891+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:38.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:38.201+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:38.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:38.929+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:39.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:39.212+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:39.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:39.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:40.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:40.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:40.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:40.844+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:41.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:41.232+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:41.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:41.875+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:42.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:42.202+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:42.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:42.873+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:43.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:43.176+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:43.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:43.861+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:44.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:44.163+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:44.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:44.862+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:45.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:45.162+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:45.813 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:45.813+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:46.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:46.204+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:46.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:46.821+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:47.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:47.184+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:47.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:47.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:48.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:48.137+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:48.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:48.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:49.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:49.097+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:49.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:49.834+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:50.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:50.111+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:50.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:50.851+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:51.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:51.144+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:51.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:51.867+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:52.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:52.139+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:52.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:52.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:53.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:53.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:53.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:53.833+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:54.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:54.133+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:54.813 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:54.811+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:55.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:55.118+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:55.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:55.859+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:56.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:56.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:56.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:56.813+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:57.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:57.148+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:57.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:57.847+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:58.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:58.163+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:58.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:58.840+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:59.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:09:59.191+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:09:59.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:09:59.869+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:00.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:00.229+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:00.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:00.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:01.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:01.192+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:01.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:01.890+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:02.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:02.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:02.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:02.916+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:03.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:03.196+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:03.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:03.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:04.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:04.184+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:04.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:04.961+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:05.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:05.195+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:05.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:05.992+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:06.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:06.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:06.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:06.970+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:07.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:07.196+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:07.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:07.922+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:08.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:08.221+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:08.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:08.947+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:09.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:09.205+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:09.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:09.984+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:10.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:10.196+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:11.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:11.009+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:11.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:11.205+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:12.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:12.053+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:12.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:12.255+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:13.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:13.078+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:13.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:13.251+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:14.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:14.075+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:14.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:14.223+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:15.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:15.117+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:15.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:15.233+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:16.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:16.132+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:16.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:16.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:17.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:17.182+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:17.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:17.237+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:18.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:18.205+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:18.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:18.230+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:19.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:19.167+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:19.225 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:19.223+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:20.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:20.128+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:20.191 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:20.189+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:21.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:21.118+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:21.229 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:21.228+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:22.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:22.105+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:22.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:22.215+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:23.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:23.090+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:23.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:23.236+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:24.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:24.130+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:24.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:24.203+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:25.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:25.088+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:25.176 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:25.175+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:26.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:26.098+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:26.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:26.172+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:27.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:27.128+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:27.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:27.177+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:28.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:28.147+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:28.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:28.152+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:29.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:29.106+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:29.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:29.128+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:30.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:30.076+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:30.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:30.140+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:31.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:31.080+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:31.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:31.165+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:32.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:32.094+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:32.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:32.180+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:33.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:33.120+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:33.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:33.189+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:34.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:34.123+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:34.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:34.234+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:35.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:35.110+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:35.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:35.210+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:36.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:36.117+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:36.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:36.221+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:37.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:37.073+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:37.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:37.257+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:38.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:38.037+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:38.281 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:38.280+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:39.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:39.073+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:39.244 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:39.243+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:40.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:40.076+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:40.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:40.217+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:41.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:41.097+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:41.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:41.210+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:42.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:42.126+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:42.253 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:42.252+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:43.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:43.128+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:43.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:43.233+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:44.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:44.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:44.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:44.207+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:45.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:45.081+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:45.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:45.218+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:46.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:46.063+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:46.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:46.229+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:47.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:47.087+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:47.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:47.191+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:48.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:48.099+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:48.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:48.199+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:49.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:49.141+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:49.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:49.213+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:50.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:50.101+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:50.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:50.230+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:51.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:51.105+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:51.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:51.216+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:52.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:52.097+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:52.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:52.171+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:53.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:53.137+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:53.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:53.191+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:54.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:54.167+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:54.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:54.179+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:55.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:55.158+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:55.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:55.207+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:56.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:56.191+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:56.246 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:56.244+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:57.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:57.193+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:57.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:57.202+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:58.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:58.205+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:58.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:58.235+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:59.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:10:59.195+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:10:59.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:10:59.233+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:00.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:00.213+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:00.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:00.283+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:01.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:01.217+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:01.328 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:01.327+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:02.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:02.174+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:02.360 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:02.359+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:03.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:03.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:03.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:03.313+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:04.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:04.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:04.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:04.337+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:05.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:05.167+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:05.371 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:05.370+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:06.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:06.144+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:06.322 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:06.321+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:07.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:07.114+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:07.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:07.347+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:08.066 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:08.065+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:08.371 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:08.370+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:09.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:09.085+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:09.410 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:09.410+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:10.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:10.103+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:10.434 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:10.434+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:11.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:11.065+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:11.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:11.457+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:12.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:12.087+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:12.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:12.501+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:13.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:13.119+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:13.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:13.530+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:14.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:14.114+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:14.525 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:14.525+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:15.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:15.095+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:15.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:15.517+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:16.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:16.135+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:16.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:16.566+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:17.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:17.172+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:17.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:17.578+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:18.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:18.178+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:18.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:18.573+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:19.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:19.161+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:19.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:19.618+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:20.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:20.172+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:20.651 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:20.651+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:21.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:21.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:21.701 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:21.700+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:22.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:22.168+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:22.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:22.679+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:23.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:23.170+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:23.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:23.670+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:24.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:24.151+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:24.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:24.673+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:25.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:25.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:25.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:25.663+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:26.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:26.107+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:26.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:26.680+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:27.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:27.088+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:27.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:27.674+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:28.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:28.138+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:28.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:28.679+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:29.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:29.120+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:29.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:29.669+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:30.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:30.154+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:30.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:30.709+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:31.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:31.201+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:31.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:31.724+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:32.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:32.166+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:32.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:32.683+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:33.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:33.200+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:33.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:33.641+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:34.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:34.181+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:34.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:34.611+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:35.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:35.169+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:35.651 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:35.650+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:36.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:36.128+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:36.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:36.679+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:37.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:37.152+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:37.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:37.672+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:38.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:38.173+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:38.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:38.701+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:39.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:39.125+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:39.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:39.725+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:40.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:40.082+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:40.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:40.746+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:41.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:41.055+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:41.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:41.715+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:42.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:42.078+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:42.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:42.750+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:43.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:43.041+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:43.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:43.780+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:44.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:44.046+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:44.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:44.763+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:45.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:45.058+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:45.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:45.804+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:46.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:46.100+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:46.760 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:46.759+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:47.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:47.069+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:47.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:47.804+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:48.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:48.042+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:48.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:48.833+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:49.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:49.079+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:49.791 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:49.790+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:50.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:50.126+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:50.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:50.805+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:51.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:51.118+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:51.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:51.779+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:52.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:52.133+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:52.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:52.735+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:53.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:53.183+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:53.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:53.698+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:54.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:54.220+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:54.658 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:54.658+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:55.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:55.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:55.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:55.629+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:56.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:56.296+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:56.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:56.612+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:57.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:57.302+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:57.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:57.612+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:58.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:58.264+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:58.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:58.634+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:59.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:11:59.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:11:59.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:11:59.659+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:00.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:00.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:00.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:00.698+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:01.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:01.258+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:01.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:01.684+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:02.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:02.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:02.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:02.732+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:03.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:03.304+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:03.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:03.712+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:04.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:04.280+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:04.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:04.690+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:05.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:05.313+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:05.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:05.708+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:06.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:06.343+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:06.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:06.747+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:07.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:07.306+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:07.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:07.775+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:08.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:08.316+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:08.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:08.731+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:09.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:09.340+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:09.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:09.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:10.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:10.298+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:10.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:10.747+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:11.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:11.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:11.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:11.749+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:12.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:12.259+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:12.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:12.781+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:13.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:13.278+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:13.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:13.755+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:14.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:14.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:14.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:14.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:15.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:15.254+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:15.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:15.773+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:16.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:16.230+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:16.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:16.768+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:17.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:17.186+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:17.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:17.771+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:18.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:18.233+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:18.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:18.789+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:19.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:19.197+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:19.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:19.783+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:20.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:20.172+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:20.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:20.742+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:21.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:21.134+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:21.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:21.784+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:22.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:22.109+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:22.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:22.825+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:23.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:23.119+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:23.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:23.843+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:24.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:24.077+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:24.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:24.869+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:25.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:25.095+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:25.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:25.885+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:26.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:26.137+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:26.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:26.921+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:27.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:27.100+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:27.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:27.932+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:28.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:28.062+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:28.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:28.892+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:29.029 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:29.028+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:29.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:29.915+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:30.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:30.045+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:30.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:30.939+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:31.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:31.027+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:31.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:31.932+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:32.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:32.072+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:32.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:32.921+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:33.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:33.056+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:33.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:33.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:34.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:34.087+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:34.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:34.899+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:35.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:35.127+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:35.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:35.857+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:36.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:36.101+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:36.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:36.876+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:37.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:37.085+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:37.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:37.872+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:38.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:38.047+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:38.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:38.899+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:39.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:39.019+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:39.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:39.857+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:39.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:39.981+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:40.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:40.906+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:40.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:40.992+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:41.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:41.876+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:41.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:41.979+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:42.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:42.835+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:42.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:42.989+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:43.811 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:43.811+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:43.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:43.970+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:44.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:44.859+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:44.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:44.978+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:45.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:45.843+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:45.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:45.987+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:46.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:46.859+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:46.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:46.953+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:47.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:47.834+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:47.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:47.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:48.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:48.786+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:48.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:48.969+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:49.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:49.806+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:49.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:49.972+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:50.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:50.830+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:50.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:50.978+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:51.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:51.800+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:51.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:51.959+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:52.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:52.820+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:52.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:52.979+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:53.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:53.785+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:54.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:54.005+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:54.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:54.823+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:55.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:55.030+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:55.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:55.836+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:56.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:56.041+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:56.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:56.829+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:57.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:57.053+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:57.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:57.843+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:58.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:58.046+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:58.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:58.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:59.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:12:59.028+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:12:59.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:12:59.868+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:00.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:00.004+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:00.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:00.884+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:01.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:01.048+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:01.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:01.932+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:02.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:02.018+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:02.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:02.934+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:02.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:02.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:03.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:03.968+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:03.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:03.996+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:04.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:04.976+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:05.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:05.037+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:05.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:05.978+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:05.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:05.991+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:06.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:06.965+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:07.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:07.029+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:07.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:07.988+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:08.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:08.044+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:08.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:08.973+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:09.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:09.001+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:09.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:09.981+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:09.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:09.985+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:11.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:11.001+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:11.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:11.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:12.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:12.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:12.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:12.032+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:13.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:13.041+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:13.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:13.076+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:14.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:14.058+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:14.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:14.102+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:15.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:15.064+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:15.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:15.136+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:16.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:16.088+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:16.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:16.102+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:17.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:17.041+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:17.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:17.122+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:18.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:18.050+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:18.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:18.167+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:19.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:19.058+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:19.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:19.197+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:20.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:20.066+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:20.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:20.184+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:21.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:21.035+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:21.223 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:21.223+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:22.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:22.084+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:22.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:22.194+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:23.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:23.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:23.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:23.151+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:24.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:24.081+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:24.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:24.157+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:25.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:25.068+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:25.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:25.193+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:26.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:26.040+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:26.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:26.188+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:27.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:27.000+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:27.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:27.156+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:28.008 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:28.008+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:28.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:28.144+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:28.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:28.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:29.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:29.126+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:30.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:30.023+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:30.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:30.127+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:31.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:31.006+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:31.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:31.124+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:32.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:32.021+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:32.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:32.074+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:33.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:33.037+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:33.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:33.070+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:34.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:34.041+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:34.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:34.041+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:35.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:35.004+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:35.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:35.023+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:36.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:36.047+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:36.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:36.047+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:37.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:37.020+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:37.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:37.084+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:38.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:38.003+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:38.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:38.038+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:38.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:38.966+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:39.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:39.078+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:39.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:39.937+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:40.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:40.092+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:40.895 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:40.894+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:41.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:41.063+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:41.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:41.846+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:42.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:42.043+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:42.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:42.819+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:43.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:43.084+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:43.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:43.795+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:44.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:44.083+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:44.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:44.797+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:45.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:45.066+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:45.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:45.811+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:46.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:46.019+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:46.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:46.827+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:47.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:47.045+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:47.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:47.874+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:48.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:48.089+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:48.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:48.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:49.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:49.042+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:49.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:49.879+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:50.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:50.078+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:50.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:50.889+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:51.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:51.067+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:51.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:51.905+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:52.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:52.101+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:52.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:52.884+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:53.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:53.117+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:53.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:53.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:54.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:54.099+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:54.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:54.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:55.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:55.115+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:55.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:55.855+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:56.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:56.075+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:56.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:56.874+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:57.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:57.083+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:57.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:57.924+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:58.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:58.050+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:58.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:58.969+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:59.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:13:59.023+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:13:59.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:13:59.966+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:00.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:00.005+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:00.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:00.929+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:01.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:01.004+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:01.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:01.979+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:02.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:02.008+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:02.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:02.941+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:02.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:02.983+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:03.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:03.941+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:03.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:03.985+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:04.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:04.977+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:05.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:05.013+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:05.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:05.969+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:06.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:06.017+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:06.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:06.951+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:06.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:06.983+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:07.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:07.984+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:07.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:07.995+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:08.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:08.943+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:09.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:09.031+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:09.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:09.902+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:10.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:10.057+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:10.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:10.886+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:11.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:11.083+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:11.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:11.929+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:12.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:12.125+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:12.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:12.930+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:13.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:13.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:13.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:13.929+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:14.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:14.162+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:14.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:14.900+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:15.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:15.152+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:15.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:15.870+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:16.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:16.184+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:16.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:16.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:17.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:17.141+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:17.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:17.848+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:18.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:18.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:18.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:18.804+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:19.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:19.186+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:19.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:19.791+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:20.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:20.191+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:20.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:20.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:21.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:21.163+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:21.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:21.778+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:22.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:22.120+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:22.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:22.786+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:23.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:23.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:23.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:23.754+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:24.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:24.202+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:24.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:24.768+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:25.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:25.166+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:25.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:25.791+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:26.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:26.171+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:26.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:26.800+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:27.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:27.142+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:27.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:27.844+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:28.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:28.134+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:28.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:28.822+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:29.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:29.168+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:29.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:29.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:30.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:30.140+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:30.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:30.850+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:31.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:31.126+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:31.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:31.824+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:32.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:32.162+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:32.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:32.798+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:33.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:33.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:33.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:33.753+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:34.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:34.100+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:34.781 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:34.780+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:35.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:35.138+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:35.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:35.783+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:36.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:36.168+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:36.799 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:36.798+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:37.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:37.214+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:37.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:37.802+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:38.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:38.169+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:38.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:38.792+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:39.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:39.160+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:39.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:39.840+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:40.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:40.127+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:40.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:40.806+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:41.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:41.103+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:41.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:41.817+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:42.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:42.120+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:42.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:42.817+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:43.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:43.076+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:43.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:43.830+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:44.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:44.125+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:44.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:44.874+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:45.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:45.164+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:45.829 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:45.829+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:46.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:46.168+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:46.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:46.788+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:47.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:47.181+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:47.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:47.751+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:48.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:48.159+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:48.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:48.717+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:49.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:49.169+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:49.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:49.716+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:50.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:50.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:50.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:50.705+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:51.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:51.164+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:51.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:51.673+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:52.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:52.154+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:52.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:52.659+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:53.151 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:53.151+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:53.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:53.687+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:54.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:54.111+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:54.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:54.694+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:55.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:55.068+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:55.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:55.686+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:56.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:56.032+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:56.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:56.683+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:57.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:57.044+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:57.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:57.702+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:58.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:58.033+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:58.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:58.681+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:59.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:14:59.082+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:14:59.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:14:59.704+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:00.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:00.094+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:00.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:00.732+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:01.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:01.064+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:01.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:01.718+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:02.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:02.066+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:02.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:02.717+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:03.027 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:03.026+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:03.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:03.722+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:03.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:03.977+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:04.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:04.763+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:04.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:04.984+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:05.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:05.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:06.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:06.002+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:06.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:06.752+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:07.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:07.018+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:07.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:07.792+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:07.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:07.973+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:08.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:08.776+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:08.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:08.993+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:09.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:09.757+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:10.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:10.039+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:10.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:10.711+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:11.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:11.011+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:11.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:11.671+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:12.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:12.022+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:12.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:12.714+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:12.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:12.979+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:13.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:13.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:13.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:13.992+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:14.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:14.718+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:14.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:14.974+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:15.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:15.748+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:15.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:15.994+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:16.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:16.747+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:17.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:17.019+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:17.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:17.795+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:18.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:18.033+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:18.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:18.813+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:19.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:19.067+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:19.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:19.830+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:20.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:20.104+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:20.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:20.784+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:21.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:21.123+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:21.781 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:21.780+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:22.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:22.081+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:22.783 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:22.782+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:23.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:23.117+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:23.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:23.775+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:24.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:24.142+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:24.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:24.756+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:25.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:25.147+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:25.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:25.750+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:26.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:26.188+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:26.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:26.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:27.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:27.155+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:27.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:27.710+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:28.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:28.112+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:28.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:28.707+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:29.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:29.108+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:29.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:29.707+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:30.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:30.081+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:30.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:30.752+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:31.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:31.082+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:31.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:31.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:32.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:32.127+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:32.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:32.773+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:33.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:33.088+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:33.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:33.793+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:34.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:34.094+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:34.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:34.779+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:35.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:35.112+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:35.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:35.823+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:36.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:36.090+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:36.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:36.796+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:37.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:37.123+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:37.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:37.761+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:38.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:38.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:38.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:38.771+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:39.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:39.124+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:39.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:39.768+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:40.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:40.095+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:40.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:40.797+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:41.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:41.095+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:41.813 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:41.813+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:42.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:42.098+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:42.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:42.841+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:43.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:43.116+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:43.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:43.879+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:44.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:44.129+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:44.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:44.891+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:45.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:45.082+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:45.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:45.863+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:46.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:46.071+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:46.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:46.851+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:47.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:47.053+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:47.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:47.858+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:48.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:48.086+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:48.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:48.822+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:49.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:49.070+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:49.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:49.867+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:50.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:50.021+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:50.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:50.912+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:51.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:51.007+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:51.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:51.942+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:51.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:51.993+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:52.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:52.965+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:53.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:53.015+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:53.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:53.981+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:53.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:53.981+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:54.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:54.980+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:54.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:54.990+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:55.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:55.974+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:55.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:55.980+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:56.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:56.982+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:57.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:57.006+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:57.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:57.973+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:58.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:58.018+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:58.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:15:58.998+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:59.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:59.001+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:15:59.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:15:59.986+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:00.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:00.015+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:00.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:00.969+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:00.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:00.971+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:01.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:01.996+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:02.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:02.012+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:02.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:02.992+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:03.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:03.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:03.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:03.992+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:03.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:03.995+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:04.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:04.987+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:05.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:05.001+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:05.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:05.976+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:05.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:05.998+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:06.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:06.972+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:06.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:06.973+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:07.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:07.931+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:07.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:07.994+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:08.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:08.967+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:08.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:08.979+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:09.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:09.924+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:09.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:09.948+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:10.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:10.899+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:10.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:10.978+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:11.899 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:11.898+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:11.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:11.995+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:12.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:12.948+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:13.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:13.003+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:13.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:13.961+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:13.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:13.967+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:14.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:14.918+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:14.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:14.951+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:15.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:15.912+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:15.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:15.915+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:16.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:16.920+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:16.920 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:16.920+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:17.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:17.930+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:17.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:17.937+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:18.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:18.931+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:18.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:18.957+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:19.909 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:19.908+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:19.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:19.957+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:20.872 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:20.872+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:20.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:20.997+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:21.861 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:21.861+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:22.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:22.017+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:22.853 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:22.852+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:23.053 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:23.052+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:23.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:23.855+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:24.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:24.028+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:24.820 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:24.820+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:24.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:24.979+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:25.797 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:25.795+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:26.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:26.024+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:26.800 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:26.798+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:26.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:26.991+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:27.751 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:27.750+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:27.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:27.984+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:28.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:28.757+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:28.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:28.973+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:29.796 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:29.794+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:29.987 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:29.986+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:30.793 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:30.792+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:30.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:30.990+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:31.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:31.774+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:31.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:31.998+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:32.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:32.776+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:33.031 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:33.030+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:33.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:33.804+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:34.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:34.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:34.843 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:34.841+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:34.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:34.993+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:35.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:35.873+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:35.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:35.961+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:36.917 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:36.916+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:36.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:36.994+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:37.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:37.921+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:37.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:37.966+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:38.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:38.935+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:38.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:38.950+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:39.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:39.927+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:39.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:39.957+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:40.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:40.892+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:40.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:40.957+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:41.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:41.914+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:41.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:41.944+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:42.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:42.914+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:42.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:42.922+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:43.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:43.898+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:43.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:43.968+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:44.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:44.910+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:44.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:44.992+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:45.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:45.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:45.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:45.953+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:46.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:46.910+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:46.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:46.961+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:47.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:47.913+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:47.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:47.951+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:48.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:48.927+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:48.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:48.949+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:49.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:49.908+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:49.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:49.911+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:50.895 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:50.894+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:50.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:50.958+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:51.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:51.888+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:51.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:51.988+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:52.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:52.936+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:52.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:52.944+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:53.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:53.909+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:53.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:53.949+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:54.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:54.917+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:54.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:54.942+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:55.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:55.925+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:55.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:55.929+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:56.887 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:56.885+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:56.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:56.952+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:57.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:57.920+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:57.987 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:57.986+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:58.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:58.914+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:58.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:16:58.963+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:16:59.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:16:59.932+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:00.005 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:00.004+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:00.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:00.957+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:00.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:00.976+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:01.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:01.913+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:01.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:01.932+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:02.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:02.915+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:02.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:02.946+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:03.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:03.950+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:03.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:03.983+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:04.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:04.940+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:05.000 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:04.999+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:05.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:05.982+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:06.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:06.048+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:07.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:07.007+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:07.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:07.012+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:07.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:07.982+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:08.029 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:08.028+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:08.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:08.959+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:09.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:09.069+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:09.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:09.965+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:10.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:10.068+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:10.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:10.953+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:11.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:11.091+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:11.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:11.983+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:12.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:12.050+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:12.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:12.962+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:13.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:13.081+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:13.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:13.977+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:14.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:14.105+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:15.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:15.016+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:15.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:15.071+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:16.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:16.055+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:16.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:16.098+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:17.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:17.024+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:17.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:17.063+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:18.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:18.027+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:18.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:18.061+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:18.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:18.989+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:19.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:19.071+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:19.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:19.985+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:20.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:20.085+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:20.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:20.996+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:21.053 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:21.052+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:21.987 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:21.986+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:22.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:22.094+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:22.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:22.975+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:23.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:23.127+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:23.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:23.949+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:24.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:24.134+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:24.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:24.987+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:25.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:25.122+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:25.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:25.964+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:26.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:26.139+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:27.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:27.011+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:27.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:27.137+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:28.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:28.049+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:28.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:28.137+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:29.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:29.008+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:29.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:29.151+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:30.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:30.040+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:30.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:30.147+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:31.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:31.058+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:31.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:31.164+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:32.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:32.106+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:32.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:32.205+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:33.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:33.141+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:33.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:33.239+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:34.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:34.093+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:34.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:34.232+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:35.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:35.143+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:35.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:35.195+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:36.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:36.143+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:36.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:36.184+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:37.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:37.141+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:37.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:37.147+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:38.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:38.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:38.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:38.160+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:39.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:39.156+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:39.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:39.180+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:40.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:40.128+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:40.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:40.212+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:41.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:41.175+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:41.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:41.247+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:42.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:42.163+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:42.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:42.265+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:43.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:43.121+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:43.276 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:43.276+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:44.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:44.131+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:44.286 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:44.286+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:45.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:45.163+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:45.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:45.289+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:46.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:46.131+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:46.295 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:46.295+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:47.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:47.103+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:47.316 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:47.315+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:48.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:48.103+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:48.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:48.305+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:49.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:49.149+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:49.345 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:49.345+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:50.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:50.113+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:50.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:50.353+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:51.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:51.123+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:51.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:51.332+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:52.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:52.137+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:52.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:52.314+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:53.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:53.119+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:53.357 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:53.356+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:54.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:54.077+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:54.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:54.389+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:55.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:55.118+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:55.346 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:55.345+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:56.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:56.116+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:56.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:56.345+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:57.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:57.158+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:57.349 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:57.348+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:58.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:58.186+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:58.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:58.350+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:59.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:17:59.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:17:59.369 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:17:59.368+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:00.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:00.242+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:00.402 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:00.401+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:01.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:01.275+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:01.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:01.384+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:02.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:02.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:02.372 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:02.371+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:03.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:03.218+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:03.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:03.388+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:04.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:04.208+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:04.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:04.360+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:05.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:05.199+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:05.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:05.376+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:06.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:06.153+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:06.339 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:06.338+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:07.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:07.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:07.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:07.332+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:08.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:08.204+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:08.319 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:08.318+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:09.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:09.199+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:09.290 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:09.288+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:10.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:10.165+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:10.269 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:10.268+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:11.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:11.165+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:11.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:11.277+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:12.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:12.149+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:12.324 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:12.323+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:13.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:13.186+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:13.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:13.358+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:14.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:14.236+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:14.370 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:14.368+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:15.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:15.254+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:15.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:15.391+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:16.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:16.214+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:16.387 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:16.386+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:17.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:17.173+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:17.368 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:17.366+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:18.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:18.200+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:18.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:18.415+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:19.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:19.243+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:19.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:19.442+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:20.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:20.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:20.465 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:20.463+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:21.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:21.252+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:21.433 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:21.432+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:22.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:22.237+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:22.418 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:22.417+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:23.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:23.246+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:23.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:23.404+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:24.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:24.252+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:24.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:24.384+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:25.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:25.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:25.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:25.394+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:26.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:26.244+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:26.370 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:26.370+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:27.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:27.239+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:27.372 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:27.372+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:28.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:28.240+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:28.399 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:28.399+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:29.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:29.281+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:29.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:29.350+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:30.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:30.277+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:30.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:30.364+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:31.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:31.248+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:31.407 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:31.407+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:32.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:32.298+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:32.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:32.403+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:33.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:33.281+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:33.414 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:33.414+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:34.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:34.314+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:34.435 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:34.434+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:35.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:35.338+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:35.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:35.404+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:36.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:36.295+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:36.392 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:36.391+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:37.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:37.253+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:37.399 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:37.397+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:38.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:38.298+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:38.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:38.409+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:39.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:39.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:39.386 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:39.385+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:40.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:40.242+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:40.429 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:40.427+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:41.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:41.292+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:41.461 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:41.460+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:42.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:42.276+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:42.454 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:42.453+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:43.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:43.271+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:43.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:43.473+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:44.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:44.279+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:44.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:44.501+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:45.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:45.247+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:45.500 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:45.499+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:46.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:46.233+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:46.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:46.480+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:47.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:47.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:47.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:47.472+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:48.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:48.209+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:48.477 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:48.476+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:49.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:49.181+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:49.498 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:49.497+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:50.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:50.208+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:50.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:50.505+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:51.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:51.172+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:51.538 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:51.537+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:52.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:52.163+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:52.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:52.501+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:53.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:53.209+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:53.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:53.472+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:54.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:54.209+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:54.468 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:54.467+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:55.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:55.189+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:55.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:55.477+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:56.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:56.195+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:56.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:56.515+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:57.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:57.165+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:57.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:57.539+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:58.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:58.162+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:58.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:58.579+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:59.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:18:59.122+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:18:59.633 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:18:59.629+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:00.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:00.143+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:00.619 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:00.618+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:01.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:01.121+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:01.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:01.658+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:02.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:02.073+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:02.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:02.658+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:03.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:03.063+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:03.676 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:03.674+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:04.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:04.103+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:04.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:04.645+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:05.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:05.087+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:05.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:05.649+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:06.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:06.070+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:06.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:06.663+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:07.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:07.081+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:07.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:07.647+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:08.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:08.094+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:08.657 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:08.657+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:09.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:09.067+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:09.609 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:09.609+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:10.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:10.031+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:10.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:10.567+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:11.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:11.052+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:11.539 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:11.539+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:12.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:12.057+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:12.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:12.574+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:13.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:13.068+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:13.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:13.531+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:14.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:14.035+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:14.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:14.581+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:15.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:15.057+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:15.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:15.621+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:16.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:16.059+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:16.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:16.666+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:17.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:17.101+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:17.663 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:17.663+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:18.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:18.095+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:18.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:18.694+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:19.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:19.126+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:19.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:19.688+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:20.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:20.116+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:20.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:20.709+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:21.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:21.072+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:21.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:21.688+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:22.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:22.076+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:22.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:22.678+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:23.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:23.040+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:23.707 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:23.706+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:24.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:24.084+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:24.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:24.672+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:25.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:25.106+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:25.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:25.711+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:26.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:26.149+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:26.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:26.738+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:27.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:27.154+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:27.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:27.710+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:28.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:28.150+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:28.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:28.733+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:29.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:29.104+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:29.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:29.780+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:30.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:30.146+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:30.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:30.829+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:31.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:31.178+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:31.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:31.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:32.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:32.148+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:32.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:32.910+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:33.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:33.196+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:33.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:33.904+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:34.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:34.166+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:34.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:34.938+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:35.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:35.196+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:35.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:35.943+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:36.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:36.166+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:36.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:36.991+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:37.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:37.215+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:38.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:38.003+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:38.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:38.212+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:38.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:38.965+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:39.259 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:39.258+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:39.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:39.985+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:40.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:40.273+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:40.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:40.948+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:41.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:41.310+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:41.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:41.990+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:42.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:42.306+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:42.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:42.955+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:43.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:43.356+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:43.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:43.957+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:44.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:44.326+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:44.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:44.957+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:45.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:45.281+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:45.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:45.910+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:46.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:46.265+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:46.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:46.935+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:47.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:47.312+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:47.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:47.896+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:48.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:48.293+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:48.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:48.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:49.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:49.308+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:49.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:49.907+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:50.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:50.318+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:50.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:50.903+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:51.321 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:51.317+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:51.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:51.925+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:52.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:52.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:52.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:52.908+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:53.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:53.264+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:53.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:53.902+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:54.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:54.298+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:54.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:54.900+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:55.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:55.302+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:55.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:55.951+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:56.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:56.297+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:56.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:56.996+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:57.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:57.257+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:57.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:57.962+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:58.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:58.210+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:59.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:59.012+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:59.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:19:59.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:19:59.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:19:59.991+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:00.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:00.188+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:00.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:00.978+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:01.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:01.150+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:02.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:02.010+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:02.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:02.200+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:02.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:02.978+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:03.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:03.195+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:03.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:03.937+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:04.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:04.195+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:04.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:04.962+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:05.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:05.219+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:05.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:05.939+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:06.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:06.239+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:06.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:06.921+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:07.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:07.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:07.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:07.948+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:08.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:08.217+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:08.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:08.981+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:09.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:09.211+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:10.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:10.025+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:10.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:10.254+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:11.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:11.007+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:11.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:11.268+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:11.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:11.997+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:12.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:12.269+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:12.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:12.981+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:13.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:13.273+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:14.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:14.015+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:14.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:14.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:15.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:15.014+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:15.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:15.251+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:16.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:16.032+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:16.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:16.288+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:17.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:17.057+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:17.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:17.318+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:18.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:18.070+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:18.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:18.334+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:19.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:19.043+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:19.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:19.353+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:20.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:20.088+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:20.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:20.318+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:21.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:21.107+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:21.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:21.346+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:22.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:22.115+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:22.382 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:22.381+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:23.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:23.079+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:23.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:23.431+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:24.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:24.035+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:24.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:24.428+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:25.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:25.041+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:25.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:25.396+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:26.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:26.060+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:26.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:26.364+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:27.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:27.015+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:27.330 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:27.329+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:27.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:27.989+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:28.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:28.341+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:28.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:28.982+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:29.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:29.307+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:29.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:29.982+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:30.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:30.303+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:31.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:31.001+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:31.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:31.256+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:32.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:32.040+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:32.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:32.271+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:33.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:33.000+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:33.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:33.296+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:34.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:34.046+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:34.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:34.255+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:35.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:35.068+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:35.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:35.218+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:36.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:36.096+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:36.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:36.262+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:37.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:37.056+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:37.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:37.239+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:38.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:38.064+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:38.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:38.288+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:39.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:39.068+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:39.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:39.261+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:40.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:40.089+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:40.259 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:40.259+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:41.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:41.135+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:41.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:41.234+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:42.138 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:42.137+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:42.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:42.268+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:43.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:43.145+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:43.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:43.228+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:44.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:44.130+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:44.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:44.202+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:45.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:45.120+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:45.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:45.247+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:46.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:46.151+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:46.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:46.268+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:47.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:47.155+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:47.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:47.228+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:48.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:48.159+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:48.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:48.211+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:49.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:49.169+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:49.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:49.180+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:50.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:50.167+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:50.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:50.175+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:51.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:51.156+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:51.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:51.158+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:52.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:52.154+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:52.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:52.202+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:53.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:53.144+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:53.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:53.219+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:54.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:54.120+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:54.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:54.194+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:55.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:55.120+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:55.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:55.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:56.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:56.087+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:56.242 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:56.241+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:57.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:57.122+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:57.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:57.218+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:58.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:58.134+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:58.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:58.250+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:59.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:20:59.149+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:20:59.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:20:59.283+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:00.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:00.130+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:00.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:00.288+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:01.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:01.159+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:01.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:01.300+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:02.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:02.140+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:02.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:02.260+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:03.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:03.145+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:03.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:03.307+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:04.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:04.191+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:04.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:04.349+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:05.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:05.147+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:05.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:05.369+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:06.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:06.106+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:06.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:06.357+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:07.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:07.083+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:07.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:07.308+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:08.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:08.055+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:08.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:08.273+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:09.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:09.009+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:09.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:09.272+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:10.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:10.011+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:10.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:10.261+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:11.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:11.039+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:11.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:11.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:11.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:11.991+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:12.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:12.242+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:13.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:13.029+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:13.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:13.271+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:14.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:14.030+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:14.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:14.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:15.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:15.027+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:15.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:15.241+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:16.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:16.044+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:16.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:16.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:17.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:17.045+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:17.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:17.184+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:18.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:18.027+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:18.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:18.220+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:19.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:19.042+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:19.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:19.181+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:19.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:19.994+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:20.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:20.223+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:21.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:21.042+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:21.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:21.200+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:22.053 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:22.052+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:22.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:22.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:23.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:23.012+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:23.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:23.212+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:23.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:23.974+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:24.226 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:24.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:24.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:24.993+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:25.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:25.216+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:25.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:25.956+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:26.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:26.172+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:26.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:26.963+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:27.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:27.158+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:27.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:27.935+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:28.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:28.203+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:28.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:28.944+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:29.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:29.210+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:29.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:29.951+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:30.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:30.239+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:30.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:30.959+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:31.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:31.223+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:31.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:31.971+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:32.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:32.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:32.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:32.931+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:33.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:33.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:33.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:33.886+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:34.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:34.147+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:34.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:34.840+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:35.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:35.159+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:35.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:35.880+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:36.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:36.167+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:36.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:36.879+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:37.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:37.198+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:37.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:37.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:38.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:38.156+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:38.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:38.839+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:39.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:39.198+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:39.866 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:39.864+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:40.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:40.209+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:40.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:40.825+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:41.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:41.167+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:41.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:41.860+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:42.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:42.159+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:42.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:42.840+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:43.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:43.155+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:43.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:43.883+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:44.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:44.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:44.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:44.873+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:45.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:45.158+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:45.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:45.833+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:46.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:46.157+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:46.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:46.815+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:47.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:47.109+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:47.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:47.862+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:48.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:48.079+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:48.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:48.887+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:49.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:49.071+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:49.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:49.857+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:50.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:50.114+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:50.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:50.864+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:51.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:51.093+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:51.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:51.829+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:52.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:52.064+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:52.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:52.879+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:53.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:53.107+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:53.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:53.837+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:54.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:54.089+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:54.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:54.823+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:55.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:55.092+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:55.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:55.847+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:56.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:56.112+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:56.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:56.859+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:57.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:57.152+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:57.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:57.828+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:58.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:58.151+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:58.854 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:58.853+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:59.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:21:59.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:21:59.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:21:59.875+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:00.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:00.199+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:00.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:00.855+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:01.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:01.218+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:01.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:01.896+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:02.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:02.185+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:02.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:02.885+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:03.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:03.211+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:03.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:03.902+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:04.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:04.196+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:04.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:04.881+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:05.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:05.238+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:05.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:05.835+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:06.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:06.248+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:06.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:06.808+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:07.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:07.227+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:07.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:07.773+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:08.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:08.214+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:08.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:08.759+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:09.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:09.223+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:09.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:09.771+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:10.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:10.183+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:10.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:10.775+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:11.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:11.227+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:11.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:11.774+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:12.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:12.238+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:12.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:12.727+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:13.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:13.216+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:13.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:13.681+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:14.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:14.173+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:14.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:14.671+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:15.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:15.149+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:15.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:15.671+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:16.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:16.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:16.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:16.673+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:17.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:17.170+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:17.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:17.697+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:18.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:18.162+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:18.657 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:18.656+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:19.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:19.122+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:19.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:19.671+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:20.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:20.118+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:20.624 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:20.623+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:21.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:21.115+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:21.652 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:21.651+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:22.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:22.096+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:22.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:22.645+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:23.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:23.113+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:23.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:23.693+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:24.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:24.139+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:24.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:24.663+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:25.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:25.149+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:25.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:25.676+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:26.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:26.117+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:26.652 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:26.650+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:27.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:27.126+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:27.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:27.628+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:28.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:28.165+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:28.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:28.593+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:29.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:29.162+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:29.633 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:29.632+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:30.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:30.201+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:30.663 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:30.662+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:31.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:31.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:31.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:31.664+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:32.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:32.207+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:32.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:32.700+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:33.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:33.250+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:33.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:33.687+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:34.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:34.208+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:34.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:34.694+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:35.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:35.252+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:35.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:35.714+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:36.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:36.265+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:36.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:36.672+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:37.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:37.222+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:37.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:37.714+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:38.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:38.243+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:38.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:38.750+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:39.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:39.195+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:39.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:39.735+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:40.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:40.197+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:40.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:40.710+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:41.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:41.243+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:41.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:41.704+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:42.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:42.198+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:42.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:42.735+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:43.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:43.177+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:43.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:43.772+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:44.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:44.139+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:44.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:44.725+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:45.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:45.169+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:45.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:45.682+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:46.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:46.125+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:46.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:46.720+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:47.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:47.175+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:47.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:47.712+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:48.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:48.181+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:48.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:48.735+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:49.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:49.229+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:49.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:49.727+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:50.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:50.266+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:50.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:50.723+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:51.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:51.229+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:51.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:51.674+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:52.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:52.197+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:52.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:52.665+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:53.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:53.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:53.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:53.691+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:54.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:54.214+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:54.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:54.671+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:55.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:55.204+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:55.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:55.682+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:56.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:56.183+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:56.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:56.719+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:57.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:57.159+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:57.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:57.682+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:58.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:58.154+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:58.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:58.732+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:59.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:22:59.185+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:22:59.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:22:59.758+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:00.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:00.226+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:00.783 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:00.782+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:01.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:01.190+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:01.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:01.793+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:02.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:02.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:02.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:02.773+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:03.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:03.132+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:03.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:03.744+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:04.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:04.118+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:04.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:04.716+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:05.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:05.070+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:05.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:05.685+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:06.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:06.079+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:06.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:06.736+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:07.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:07.107+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:07.720 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:07.718+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:08.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:08.068+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:08.701 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:08.699+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:09.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:09.085+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:09.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:09.689+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:10.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:10.066+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:10.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:10.641+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:11.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:11.082+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:11.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:11.671+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:12.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:12.093+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:12.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:12.624+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:13.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:13.089+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:13.609 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:13.608+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:14.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:14.089+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:14.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:14.595+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:15.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:15.064+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:15.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:15.625+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:16.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:16.068+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:16.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:16.648+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:17.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:17.117+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:17.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:17.654+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:18.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:18.159+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:18.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:18.653+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:19.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:19.126+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:19.656 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:19.655+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:20.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:20.130+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:20.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:20.673+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:21.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:21.180+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:21.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:21.707+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:22.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:22.161+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:22.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:22.704+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:23.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:23.129+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:23.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:23.680+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:24.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:24.107+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:24.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:24.706+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:25.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:25.107+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:25.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:25.739+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:26.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:26.085+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:26.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:26.751+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:27.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:27.044+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:27.781 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:27.779+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:28.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:28.012+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:28.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:28.772+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:28.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:28.974+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:29.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:29.749+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:29.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:29.960+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:30.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:30.701+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:30.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:30.966+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:31.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:31.743+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:31.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:31.934+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:32.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:32.696+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:32.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:32.977+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:33.658 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:33.657+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:34.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:34.018+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:34.619 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:34.619+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:34.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:34.990+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:35.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:35.590+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:36.008 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:36.008+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:36.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:36.601+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:37.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:37.056+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:37.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:37.568+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:38.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:38.034+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:38.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:38.562+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:39.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:39.024+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:39.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:39.543+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:40.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:40.073+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:40.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:40.548+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:41.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:41.070+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:41.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:41.559+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:42.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:42.027+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:42.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:42.516+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:43.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:43.013+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:43.524 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:43.522+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:43.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:43.997+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:44.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:44.568+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:45.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:45.009+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:45.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:45.569+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:46.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:46.059+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:46.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:46.531+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:47.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:47.104+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:47.511 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:47.510+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:48.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:48.155+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:48.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:48.478+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:49.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:49.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:49.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:49.452+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:50.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:50.193+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:50.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:50.450+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:51.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:51.233+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:51.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:51.491+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:52.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:52.249+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:52.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:52.468+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:53.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:53.205+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:53.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:53.481+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:54.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:54.233+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:54.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:54.442+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:55.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:55.211+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:55.469 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:55.467+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:56.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:56.187+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:56.423 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:56.421+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:57.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:57.231+0000 7fc59c890700 -1 osd.1 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:57.449 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:57.448+0000 7f197ded6700 -1 osd.0 155 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:58.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:58.226+0000 7fc59c890700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:58.447 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:58.446+0000 7f197ded6700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:59.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:23:59.196+0000 7fc59c890700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:23:59.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:23:59.470+0000 7f197ded6700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:00.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:00.210+0000 7fc59c890700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:00.456 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:00.454+0000 7f197ded6700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:01.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:01.234+0000 7fc59c890700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:01.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:01.459+0000 7f197ded6700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:02.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:02.233+0000 7fc59c890700 -1 osd.1 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:02.422 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:02.421+0000 7f197ded6700 -1 osd.0 156 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:03.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:03.185+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:03.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:03.393+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:04.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:04.157+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:04.432 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:04.431+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:05.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:05.194+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:05.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:05.458+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:06.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:06.192+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:06.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:06.439+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:07.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:07.198+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:07.465 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:07.464+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:08.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:08.156+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:08.448 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:08.446+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:09.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:09.185+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:09.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:09.479+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:10.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:10.223+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:10.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:10.458+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:11.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:11.271+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:11.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:11.439+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:12.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:12.276+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:12.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:12.452+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:13.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:13.234+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:13.463 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:13.462+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:14.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:14.254+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:14.501 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:14.501+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:15.246 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:15.246+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:15.507 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:15.507+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:16.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:16.209+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:16.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:16.497+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:17.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:17.248+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:17.521 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:17.520+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:18.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:18.202+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:18.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:18.548+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:19.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:19.180+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:19.594 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:19.594+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:20.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:20.194+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:20.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:20.547+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:21.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:21.146+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:21.594 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:21.594+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:22.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:22.170+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:22.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:22.564+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:23.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:23.178+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:23.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:23.564+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:24.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:24.149+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:24.594 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:24.594+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:25.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:25.175+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:25.607 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:25.606+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:26.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:26.158+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:26.565 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:26.564+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:27.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:27.136+0000 7fc59c890700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:27.546 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:27.545+0000 7f197ded6700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:28.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:28.132+0000 7fc59c890700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:28.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:28.509+0000 7f197ded6700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:29.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:29.089+0000 7fc59c890700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:29.484 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:29.482+0000 7f197ded6700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:30.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:30.093+0000 7fc59c890700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:30.454 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:30.452+0000 7f197ded6700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:31.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:31.069+0000 7fc59c890700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:31.408 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:31.406+0000 7f197ded6700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:32.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:32.050+0000 7fc59c890700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:32.418 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:32.417+0000 7f197ded6700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:33.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:33.067+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:33.439 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:33.437+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:34.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:34.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:34.468 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:34.467+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:35.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:35.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:35.439 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:35.438+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:36.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:36.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:36.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:36.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:37.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:37.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:37.446 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:37.445+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:38.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:38.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:38.488 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:38.487+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:39.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:39.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:39.500 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:39.499+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:40.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:40.130+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:40.475 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:40.474+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:41.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:41.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:41.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:41.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:42.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:42.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:42.512 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:42.511+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:43.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:43.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:43.552 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:43.551+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:44.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:44.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:44.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:44.513+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:45.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:45.067+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:45.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:45.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:46.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:46.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:46.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:46.566+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:47.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:47.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:47.601 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:47.599+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:48.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:48.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:48.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:48.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:49.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:49.139+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:49.597 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:49.596+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:50.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:50.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:50.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:50.565+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:51.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:51.169+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:51.552 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:51.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:52.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:52.130+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:52.526 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:52.524+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:53.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:53.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:53.486 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:53.485+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:54.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:54.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:54.476 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:54.474+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:55.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:55.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:55.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:55.426+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:56.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:56.233+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:56.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:56.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:57.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:57.283+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:57.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:57.461+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:58.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:58.313+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:58.451 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:58.451+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:59.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:24:59.307+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:24:59.425 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:24:59.425+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:00.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:00.283+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:00.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:00.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:01.259 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:01.259+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:01.469 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:01.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:02.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:02.241+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:02.505 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:02.505+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:03.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:03.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:03.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:03.493+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:04.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:04.293+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:04.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:04.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:05.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:05.278+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:05.535 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:05.534+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:06.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:06.299+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:06.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:06.549+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:07.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:07.253+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:07.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:07.572+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:08.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:08.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:08.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:08.547+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:09.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:09.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:09.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:09.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:10.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:10.216+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:10.565 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:10.563+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:11.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:11.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:11.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:11.549+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:12.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:12.249+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:12.583 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:12.581+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:13.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:13.266+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:13.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:13.561+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:14.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:14.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:14.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:14.571+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:15.332 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:15.330+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:15.536 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:15.535+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:16.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:16.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:16.541 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:16.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:17.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:17.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:17.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:17.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:18.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:18.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:18.535 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:18.534+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:19.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:19.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:19.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:19.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:20.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:20.385+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:20.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:20.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:21.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:21.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:21.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:21.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:22.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:22.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:22.541 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:22.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:23.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:23.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:23.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:23.568+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:24.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:24.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:24.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:24.538+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:25.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:25.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:25.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:25.562+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:26.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:26.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:26.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:26.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:27.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:27.326+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:27.619 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:27.617+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:28.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:28.302+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:28.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:28.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:29.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:29.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:29.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:29.595+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:30.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:30.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:30.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:30.586+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:31.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:31.307+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:31.546 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:31.544+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:32.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:32.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:32.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:32.572+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:33.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:33.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:33.527 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:33.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:34.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:34.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:34.483 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:34.481+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:35.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:35.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:35.526 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:35.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:36.421 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:36.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:36.560 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:36.558+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:37.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:37.411+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:37.512 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:37.510+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:38.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:38.368+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:38.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:38.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:39.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:39.326+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:39.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:39.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:40.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:40.339+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:40.490 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:40.489+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:41.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:41.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:41.447 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:41.447+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:42.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:42.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:42.408 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:42.407+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:43.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:43.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:43.436 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:43.435+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:44.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:44.244+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:44.408 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:44.407+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:45.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:45.201+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:45.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:45.391+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:46.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:46.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:46.436 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:46.435+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:47.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:47.204+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:47.406 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:47.405+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:48.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:48.177+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:48.445 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:48.445+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:49.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:49.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:49.463 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:49.463+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:50.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:50.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:50.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:50.444+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:51.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:51.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:51.489 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:51.488+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:52.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:52.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:52.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:52.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:53.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:53.216+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:53.467 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:53.466+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:54.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:54.247+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:54.483 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:54.481+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:55.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:55.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:55.445 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:55.444+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:56.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:56.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:56.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:56.441+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:57.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:57.199+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:57.423 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:57.421+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:58.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:58.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:58.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:58.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:59.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:25:59.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:25:59.415 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:25:59.414+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:00.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:00.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:00.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:00.376+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:01.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:01.220+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:01.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:01.332+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:02.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:02.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:02.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:02.375+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:03.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:03.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:03.331 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:03.330+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:04.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:04.226+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:04.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:04.350+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:05.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:05.222+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:05.320 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:05.319+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:06.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:06.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:06.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:06.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:07.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:07.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:07.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:07.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:08.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:08.211+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:08.345 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:08.343+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:09.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:09.195+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:09.375 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:09.373+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:10.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:10.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:10.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:10.392+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:11.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:11.248+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:11.406 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:11.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:12.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:12.271+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:12.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:12.363+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:13.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:13.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:13.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:13.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:14.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:14.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:14.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:14.350+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:15.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:15.342+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:15.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:15.348+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:16.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:16.312+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:16.352 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:16.350+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:17.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:17.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:17.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:17.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:18.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:18.320+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:18.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:18.351+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:19.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:19.320+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:19.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:19.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:20.303 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:20.302+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:20.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:20.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:21.290 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:21.288+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:21.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:21.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:22.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:22.302+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:22.335 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:22.334+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:23.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:23.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:23.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:23.345+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:24.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:24.313+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:24.371 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:24.371+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:25.321 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:25.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:25.380 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:25.380+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:26.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:26.319+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:26.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:26.384+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:27.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:27.357+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:27.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:27.394+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:28.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:28.311+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:28.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:28.359+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:29.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:29.293+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:29.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:29.393+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:30.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:30.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:30.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:30.376+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:31.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:31.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:31.374 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:31.374+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:32.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:32.311+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:32.370 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:32.370+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:33.335 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:33.334+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:33.337 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:33.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:34.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:34.326+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:34.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:34.380+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:35.292 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:35.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:35.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:35.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:36.281 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:36.280+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:36.355 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:36.353+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:37.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:37.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:37.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:37.383+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:38.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:38.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:38.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:38.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:39.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:39.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:39.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:39.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:40.341 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:40.339+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:40.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:40.385+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:41.317 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:41.316+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:41.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:41.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:42.317 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:42.316+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:42.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:42.370+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:43.281 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:43.280+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:43.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:43.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:44.330 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:44.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:44.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:44.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:45.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:45.334+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:45.380 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:45.379+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:46.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:46.334+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:46.424 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:46.422+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:47.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:47.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:47.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:47.426+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:48.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:48.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:48.441 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:48.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:49.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:49.329+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:49.429 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:49.428+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:50.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:50.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:50.465 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:50.464+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:51.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:51.414+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:51.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:51.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:52.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:52.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:52.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:52.508+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:53.355 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:53.353+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:53.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:53.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:54.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:54.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:54.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:54.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:55.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:55.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:55.576 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:55.574+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:56.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:56.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:56.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:56.610+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:57.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:57.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:57.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:57.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:58.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:58.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:58.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:58.585+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:59.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:26:59.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:26:59.544 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:26:59.542+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:00.396 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:00.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:00.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:00.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:01.396 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:01.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:01.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:01.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:02.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:02.405+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:02.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:02.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:03.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:03.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:03.519 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:03.518+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:04.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:04.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:04.545 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:04.544+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:05.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:05.461+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:05.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:05.559+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:06.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:06.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:06.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:06.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:07.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:07.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:07.601 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:07.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:08.397 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:08.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:08.563 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:08.563+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:09.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:09.361+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:09.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:09.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:10.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:10.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:10.541 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:10.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:11.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:11.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:11.547 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:11.546+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:12.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:12.422+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:12.519 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:12.519+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:13.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:13.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:13.500 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:13.499+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:14.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:14.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:14.521 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:14.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:15.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:15.505+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:15.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:15.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:16.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:16.491+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:16.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:16.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:17.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:17.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:17.538 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:17.538+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:18.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:18.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:18.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:18.510+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:19.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:19.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:19.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:19.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:20.454 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:20.452+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:20.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:20.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:21.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:21.468+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:21.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:21.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:22.431 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:22.429+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:22.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:22.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:23.437 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:23.436+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:23.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:23.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:24.486 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:24.485+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:24.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:24.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:25.451 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:25.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:25.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:25.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:26.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:26.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:26.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:26.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:27.450 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:27.443+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:27.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:27.503+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:28.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:28.396+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:28.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:28.494+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:29.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:29.392+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:29.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:29.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:30.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:30.375+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:30.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:30.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:31.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:31.393+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:31.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:31.461+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:32.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:32.383+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:32.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:32.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:33.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:33.359+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:33.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:33.473+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:34.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:34.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:34.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:34.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:35.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:35.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:35.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:35.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:36.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:36.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:36.455 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:36.453+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:37.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:37.385+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:37.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:37.427+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:38.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:38.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:38.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:38.409+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:39.367 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:39.366+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:39.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:39.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:40.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:40.332+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:40.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:40.421+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:41.369 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:41.367+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:41.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:41.429+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:42.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:42.357+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:42.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:42.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:43.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:43.325+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:43.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:43.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:44.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:44.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:44.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:44.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:45.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:45.314+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:45.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:45.361+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:46.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:46.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:46.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:46.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:47.304 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:47.302+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:47.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:47.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:48.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:48.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:48.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:48.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:49.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:49.285+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:49.360 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:49.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:50.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:50.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:50.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:50.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:51.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:51.300+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:51.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:51.384+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:52.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:52.313+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:52.412 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:52.412+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:53.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:53.278+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:53.380 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:53.380+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:54.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:54.257+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:54.343 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:54.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:55.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:55.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:55.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:55.392+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:56.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:56.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:56.400 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:56.400+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:57.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:57.233+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:57.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:57.405+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:58.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:58.261+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:58.380 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:58.379+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:59.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:27:59.222+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:27:59.409 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:27:59.408+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:00.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:00.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:00.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:00.428+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:01.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:01.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:01.426 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:01.425+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:02.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:02.192+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:02.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:02.443+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:03.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:03.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:03.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:03.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:04.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:04.163+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:04.466 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:04.465+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:05.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:05.201+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:05.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:05.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:06.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:06.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:06.454 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:06.452+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:07.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:07.184+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:07.442 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:07.440+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:08.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:08.195+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:08.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:08.391+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:09.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:09.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:09.421 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:09.419+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:10.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:10.195+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:10.468 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:10.467+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:11.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:11.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:11.475 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:11.474+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:12.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:12.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:12.521 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:12.519+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:13.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:13.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:13.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:13.530+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:14.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:14.218+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:14.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:14.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:15.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:15.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:15.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:15.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:16.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:16.256+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:16.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:16.577+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:17.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:17.287+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:17.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:17.604+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:18.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:18.301+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:18.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:18.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:19.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:19.281+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:19.601 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:19.599+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:20.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:20.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:20.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:20.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:21.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:21.356+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:21.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:21.568+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:22.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:22.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:22.526 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:22.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:23.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:23.416+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:23.563 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:23.561+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:24.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:24.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:24.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:24.561+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:25.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:25.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:25.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:25.563+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:26.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:26.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:26.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:26.571+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:27.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:27.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:27.554 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:27.552+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:28.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:28.389+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:28.563 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:28.561+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:29.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:29.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:29.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:29.577+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:30.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:30.399+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:30.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:30.577+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:31.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:31.363+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:31.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:31.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:32.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:32.325+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:32.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:32.530+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:33.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:33.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:33.511 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:33.510+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:34.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:34.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:34.536 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:34.534+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:35.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:35.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:35.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:35.528+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:36.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:36.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:36.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:36.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:37.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:37.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:37.524 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:37.524+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:38.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:38.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:38.508 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:38.507+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:39.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:39.453+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:39.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:39.534+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:40.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:40.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:40.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:40.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:41.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:41.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:41.528 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:41.527+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:42.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:42.350+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:42.488 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:42.487+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:43.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:43.339+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:43.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:43.506+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:44.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:44.356+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:44.521 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:44.520+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:45.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:45.350+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:45.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:45.491+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:46.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:46.308+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:46.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:46.518+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:47.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:47.300+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:47.541 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:47.539+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:48.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:48.293+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:48.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:48.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:49.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:49.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:49.547 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:49.545+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:50.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:50.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:50.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:50.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:51.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:51.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:51.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:51.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:52.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:52.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:52.519 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:52.518+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:53.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:53.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:53.504 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:53.503+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:54.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:54.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:54.490 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:54.488+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:55.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:55.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:55.536 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:55.534+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:56.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:56.311+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:56.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:56.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:57.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:57.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:57.507 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:57.506+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:58.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:58.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:58.523 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:58.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:59.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:28:59.438+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:28:59.488 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:28:59.487+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:00.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:00.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:00.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:00.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:01.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:01.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:01.466 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:01.465+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:02.446 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:02.444+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:02.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:02.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:03.414 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:03.412+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:03.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:03.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:04.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:04.451+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:04.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:04.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:05.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:05.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:05.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:05.477+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:06.455 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:06.453+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:06.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:06.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:07.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:07.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:07.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:07.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:08.430 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:08.428+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:08.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:08.524+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:09.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:09.417+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:09.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:09.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:10.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:10.375+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:10.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:10.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:11.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:11.348+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:11.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:11.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:12.312 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:12.311+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:12.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:12.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:13.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:13.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:13.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:13.575+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:14.325 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:14.324+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:14.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:14.561+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:15.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:15.339+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:15.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:15.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:16.330 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:16.329+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:16.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:16.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:17.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:17.360+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:17.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:17.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:18.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:18.390+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:18.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:18.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:19.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:19.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:19.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:19.487+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:20.365 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:20.364+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:20.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:20.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:21.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:21.363+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:21.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:21.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:22.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:22.350+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:22.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:22.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:23.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:23.331+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:23.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:23.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:24.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:24.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:24.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:24.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:25.320 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:25.319+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:25.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:25.542+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:26.342 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:26.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:26.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:26.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:27.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:27.365+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:27.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:27.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:28.381 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:28.380+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:28.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:28.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:29.370 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:29.370+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:29.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:29.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:30.337 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:30.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:30.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:30.473+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:31.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:31.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:31.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:31.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:32.306 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:32.305+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:32.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:32.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:33.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:33.312+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:33.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:33.561+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:34.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:34.337+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:34.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:34.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:35.342 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:35.340+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:35.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:35.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:36.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:36.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:36.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:36.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:37.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:37.332+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:37.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:37.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:38.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:38.335+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:38.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:38.509+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:39.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:39.352+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:39.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:39.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:40.399 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:40.398+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:40.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:40.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:41.410 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:41.409+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:41.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:41.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:42.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:42.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:42.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:42.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:43.450 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:43.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:43.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:43.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:44.498 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:44.497+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:44.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:44.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:45.536 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:45.534+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:45.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:45.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:46.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:46.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:46.558 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:46.556+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:47.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:47.473+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:47.544 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:47.543+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:48.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:48.501+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:48.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:48.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:49.486 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:49.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:49.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:49.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:50.489 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:50.488+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:50.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:50.538+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:51.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:51.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:51.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:51.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:52.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:52.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:52.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:52.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:53.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:53.508+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:53.618 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:53.616+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:54.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:54.556+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:54.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:54.643+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:55.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:55.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:55.628 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:55.626+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:56.553 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:56.551+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:56.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:56.590+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:57.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:57.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:57.617 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:57.616+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:58.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:58.580+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:58.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:58.610+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:59.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:29:59.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:29:59.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:29:59.619+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:00.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:00.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:00.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:00.622+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:01.547 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:01.546+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:01.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:01.581+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:02.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:02.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:02.617 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:02.614+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:03.487 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:03.487+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:03.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:03.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:04.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:04.491+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:04.597 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:04.597+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:05.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:05.473+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:05.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:05.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:06.519 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:06.518+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:06.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:06.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:07.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:07.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:07.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:07.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:08.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:08.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:08.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:08.543+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:09.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:09.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:09.516 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:09.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:10.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:10.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:10.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:10.565+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:11.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:11.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:11.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:11.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:12.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:12.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:12.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:12.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:13.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:13.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:13.601 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:13.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:14.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:14.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:14.648 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:14.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:15.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:15.487+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:15.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:15.687+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:16.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:16.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:16.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:16.710+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:17.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:17.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:17.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:17.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:18.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:18.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:18.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:18.648+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:19.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:19.563+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:19.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:19.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:20.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:20.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:20.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:20.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:21.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:21.520+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:21.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:21.648+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:22.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:22.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:22.645 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:22.644+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:23.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:23.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:23.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:23.683+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:24.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:24.487+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:24.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:24.648+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:25.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:25.484+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:25.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:25.677+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:26.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:26.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:26.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:26.669+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:27.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:27.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:27.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:27.622+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:28.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:28.502+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:28.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:28.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:29.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:29.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:29.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:29.674+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:30.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:30.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:30.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:30.648+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:31.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:31.500+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:31.641 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:31.640+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:32.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:32.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:32.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:32.675+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:33.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:33.549+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:33.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:33.668+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:34.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:34.568+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:34.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:34.633+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:35.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:35.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:35.607 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:35.606+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:36.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:36.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:36.658 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:36.656+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:37.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:37.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:37.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:37.693+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:38.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:38.642+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:38.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:38.691+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:39.597 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:39.596+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:39.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:39.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:40.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:40.634+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:40.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:40.714+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:41.597 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:41.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:41.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:41.697+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:42.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:42.563+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:42.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:42.667+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:43.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:43.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:43.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:43.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:44.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:44.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:44.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:44.602+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:45.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:45.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:45.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:45.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:46.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:46.565+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:46.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:46.611+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:47.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:47.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:47.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:47.660+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:48.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:48.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:48.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:48.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:49.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:49.608+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:49.654 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:49.654+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:50.612 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:50.611+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:50.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:50.620+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:51.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:51.602+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:51.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:51.638+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:52.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:52.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:52.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:52.620+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:53.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:53.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:53.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:53.637+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:54.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:54.605+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:54.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:54.609+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:55.558 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:55.557+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:55.654 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:55.653+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:56.563 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:56.562+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:56.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:56.619+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:57.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:57.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:57.604 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:57.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:58.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:58.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:58.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:58.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:59.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:30:59.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:30:59.586 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:30:59.585+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:00.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:00.605+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:00.631 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:00.630+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:01.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:01.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:01.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:01.626+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:02.624 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:02.622+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:02.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:02.673+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:03.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:03.640+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:03.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:03.653+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:04.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:04.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:04.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:04.671+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:05.652 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:05.651+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:05.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:05.671+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:06.605 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:06.603+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:06.663 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:06.661+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:07.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:07.619+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:07.648 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:07.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:08.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:08.605+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:08.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:08.645+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:09.605 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:09.603+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:09.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:09.651+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:10.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:10.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:10.670 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:10.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:11.616 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:11.615+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:11.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:11.704+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:12.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:12.638+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:12.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:12.731+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:13.663 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:13.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:13.729 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:13.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:14.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:14.619+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:14.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:14.721+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:15.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:15.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:15.712 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:15.710+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:16.648 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:16.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:16.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:16.741+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:17.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:17.641+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:17.720 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:17.719+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:18.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:18.654+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:18.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:18.769+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:19.651 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:19.649+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:19.764 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:19.762+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:20.688 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:20.686+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:20.776 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:20.775+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:21.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:21.708+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:21.816 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:21.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:22.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:22.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:22.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:22.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:23.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:23.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:23.824 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:23.823+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:24.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:24.631+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:24.865 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:24.864+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:25.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:25.594+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:25.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:25.854+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:26.614 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:26.613+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:26.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:26.830+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:27.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:27.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:27.805 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:27.804+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:28.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:28.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:28.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:28.854+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:29.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:29.660+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:29.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:29.890+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:30.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:30.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:30.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:30.928+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:31.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:31.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:31.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:31.971+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:32.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:32.716+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:32.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:32.942+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:33.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:33.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:33.965 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:33.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:34.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:34.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:34.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:34.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:35.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:35.740+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:35.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:35.934+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:36.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:36.700+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:36.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:36.984+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:37.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:37.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:38.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:38.028+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:38.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:38.680+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:39.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:39.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:39.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:39.641+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:40.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:40.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:40.600 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:40.600+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:41.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:41.124+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:41.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:41.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:42.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:42.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:42.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:42.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:43.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:43.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:43.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:43.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:44.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:44.067+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:44.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:44.635+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:45.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:45.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:45.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:45.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:46.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:46.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:46.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:46.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:47.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:47.086+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:47.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:47.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:48.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:48.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:48.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:48.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:49.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:49.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:49.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:49.740+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:50.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:50.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:50.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:50.721+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:51.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:51.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:51.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:51.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:52.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:52.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:52.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:52.748+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:53.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:53.182+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:53.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:53.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:54.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:54.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:54.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:54.746+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:55.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:55.150+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:55.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:55.725+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:56.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:56.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:56.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:56.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:57.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:57.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:57.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:57.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:58.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:58.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:58.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:58.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:59.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:31:59.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:31:59.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:31:59.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:00.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:00.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:00.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:00.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:01.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:01.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:01.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:01.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:02.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:02.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:02.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:02.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:03.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:03.207+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:03.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:03.812+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:04.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:04.257+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:04.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:04.767+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:05.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:05.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:05.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:05.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:06.321 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:06.320+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:06.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:06.807+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:07.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:07.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:07.836 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:07.835+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:08.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:08.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:08.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:08.789+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:09.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:09.349+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:09.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:09.810+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:10.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:10.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:10.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:10.784+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:11.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:11.270+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:11.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:11.750+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:12.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:12.273+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:12.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:12.795+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:13.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:13.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:13.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:13.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:14.259 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:14.258+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:14.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:14.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:15.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:15.277+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:15.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:15.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:16.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:16.279+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:16.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:16.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:17.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:17.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:17.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:17.904+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:18.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:18.300+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:18.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:18.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:19.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:19.315+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:19.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:19.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:20.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:20.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:20.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:20.930+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:21.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:21.323+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:21.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:21.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:22.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:22.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:22.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:22.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:23.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:23.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:23.863 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:23.863+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:24.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:24.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:24.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:24.894+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:25.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:25.369+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:25.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:25.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:26.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:26.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:26.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:26.873+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:27.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:27.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:27.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:27.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:28.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:28.330+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:28.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:28.911+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:29.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:29.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:29.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:29.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:30.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:30.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:30.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:30.868+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:31.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:31.365+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:31.879 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:31.878+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:32.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:32.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:32.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:32.896+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:33.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:33.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:33.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:33.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:34.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:34.378+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:34.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:34.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:35.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:35.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:35.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:35.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:36.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:36.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:36.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:36.942+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:37.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:37.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:37.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:37.905+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:38.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:38.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:38.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:38.885+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:39.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:39.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:39.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:39.883+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:40.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:40.423+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:40.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:40.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:41.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:41.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:41.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:41.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:42.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:42.429+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:42.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:42.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:43.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:43.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:43.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:43.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:44.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:44.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:44.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:44.785+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:45.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:45.437+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:45.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:45.813+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:46.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:46.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:46.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:46.785+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:47.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:47.381+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:47.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:47.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:48.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:48.378+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:48.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:48.695+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:49.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:49.378+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:49.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:49.661+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:50.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:50.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:50.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:50.620+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:51.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:51.328+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:51.619 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:51.618+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:52.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:52.369+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:52.657 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:52.655+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:53.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:53.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:53.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:53.679+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:54.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:54.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:54.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:54.695+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:55.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:55.409+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:55.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:55.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:56.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:56.434+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:56.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:56.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:57.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:57.439+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:57.799 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:57.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:58.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:58.451+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:58.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:58.798+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:59.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:32:59.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:32:59.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:32:59.761+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:00.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:00.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:00.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:00.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:01.386 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:01.385+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:01.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:01.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:02.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:02.363+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:02.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:02.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:03.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:03.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:03.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:03.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:04.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:04.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:04.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:04.744+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:05.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:05.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:05.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:05.792+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:06.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:06.370+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:06.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:06.792+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:07.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:07.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:07.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:07.838+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:08.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:08.410+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:08.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:08.848+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:09.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:09.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:09.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:09.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:10.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:10.448+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:10.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:10.858+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:11.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:11.498+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:11.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:11.862+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:12.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:12.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:12.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:12.854+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:13.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:13.589+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:13.895 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:13.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:14.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:14.582+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:14.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:14.855+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:15.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:15.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:15.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:15.896+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:16.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:16.548+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:16.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:16.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:17.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:17.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:17.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:17.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:18.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:18.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:18.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:18.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:19.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:19.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:19.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:19.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:20.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:20.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:20.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:20.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:21.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:21.508+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:21.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:21.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:22.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:22.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:22.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:22.962+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:23.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:23.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:23.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:23.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:24.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:24.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:24.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:24.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:25.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:25.581+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:25.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:25.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:26.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:26.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:26.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:26.922+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:27.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:27.581+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:27.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:27.923+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:28.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:28.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:28.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:28.904+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:29.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:29.555+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:29.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:29.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:30.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:30.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:30.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:30.911+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:31.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:31.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:31.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:31.923+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:32.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:32.548+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:32.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:32.895+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:33.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:33.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:33.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:33.863+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:34.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:34.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:34.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:34.883+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:35.561 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:35.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:35.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:35.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:36.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:36.548+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:36.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:36.888+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:37.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:37.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:37.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:37.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:38.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:38.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:38.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:38.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:39.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:39.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:39.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:39.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:40.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:40.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:40.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:40.869+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:41.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:41.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:41.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:41.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:42.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:42.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:42.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:42.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:43.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:43.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:43.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:43.841+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:44.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:44.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:44.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:44.803+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:45.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:45.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:45.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:45.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:46.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:46.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:46.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:46.813+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:47.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:47.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:47.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:47.810+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:48.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:48.613+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:48.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:48.827+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:49.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:49.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:49.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:49.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:50.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:50.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:50.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:50.835+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:51.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:51.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:51.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:51.882+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:52.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:52.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:52.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:52.897+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:53.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:53.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:53.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:53.919+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:54.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:54.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:54.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:54.910+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:55.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:55.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:55.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:55.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:56.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:56.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:56.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:56.910+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:57.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:57.538+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:57.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:57.897+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:58.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:58.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:58.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:58.853+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:59.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:33:59.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:33:59.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:33:59.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:00.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:00.591+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:00.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:00.888+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:01.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:01.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:01.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:01.839+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:02.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:02.568+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:02.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:02.863+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:03.597 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:03.596+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:03.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:03.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:04.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:04.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:04.877 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:04.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:05.632 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:05.631+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:05.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:05.921+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:06.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:06.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:06.879 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:06.878+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:07.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:07.576+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:07.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:07.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:08.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:08.591+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:08.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:08.856+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:09.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:09.619+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:09.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:09.826+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:10.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:10.580+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:10.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:10.834+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:11.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:11.581+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:11.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:11.841+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:12.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:12.590+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:12.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:12.795+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:13.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:13.605+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:13.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:13.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:14.632 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:14.631+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:14.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:14.718+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:15.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:15.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:15.760 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:15.759+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:16.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:16.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:16.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:16.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:17.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:17.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:17.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:17.766+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:18.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:18.627+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:18.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:18.778+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:19.626 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:19.625+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:19.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:19.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:20.630 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:20.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:20.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:20.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:21.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:21.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:21.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:21.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:22.670 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:22.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:22.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:22.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:23.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:23.684+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:23.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:23.777+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:24.711 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:24.711+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:24.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:24.827+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:25.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:25.696+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:25.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:25.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:26.741 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:26.741+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:26.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:26.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:27.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:27.731+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:27.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:27.784+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:28.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:28.765+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:28.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:28.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:29.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:29.735+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:29.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:29.739+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:30.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:30.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:30.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:30.775+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:31.727 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:31.727+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:31.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:31.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:32.693 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:32.691+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:32.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:32.739+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:33.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:33.643+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:33.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:33.762+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:34.633 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:34.632+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:34.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:34.778+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:35.663 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:35.663+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:35.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:35.744+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:36.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:36.672+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:36.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:36.718+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:37.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:37.665+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:37.760 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:37.758+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:38.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:38.682+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:38.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:38.762+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:39.705 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:39.704+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:39.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:39.760+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:40.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:40.694+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:40.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:40.755+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:41.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:41.720+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:41.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:41.777+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:42.699 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:42.698+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:42.813 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:42.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:43.668 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:43.666+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:43.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:43.806+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:44.656 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:44.654+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:44.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:44.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:45.700 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:45.699+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:45.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:45.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:46.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:46.684+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:46.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:46.948+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:47.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:47.708+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:47.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:47.994+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:48.705 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:48.703+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:49.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:49.032+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:49.704 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:49.703+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:50.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:50.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:50.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:50.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:51.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:51.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:51.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:51.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:52.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:52.016+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:52.768 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:52.767+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:53.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:53.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:53.756 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:53.755+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:54.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:54.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:54.711 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:54.709+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:55.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:55.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:55.677 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:55.675+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:56.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:56.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:56.678 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:56.676+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:56.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:56.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:57.657 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:57.655+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:57.973 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:57.972+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:58.689 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:58.687+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:58.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:58.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:59.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:34:59.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:34:59.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:34:59.900+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:00.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:00.691+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:00.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:00.915+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:01.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:01.740+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:01.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:01.889+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:02.693 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:02.691+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:02.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:02.854+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:03.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:03.695+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:03.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:03.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:04.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:04.708+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:04.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:04.836+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:05.687 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:05.686+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:05.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:05.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:06.716 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:06.715+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:06.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:06.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:07.693 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:07.691+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:07.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:07.779+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:08.669 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:08.669+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:08.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:08.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:09.670 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:09.669+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:09.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:09.772+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:10.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:10.631+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:10.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:10.798+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:11.681 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:11.679+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:11.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:11.785+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:12.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:12.643+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:12.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:12.806+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:13.688 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:13.687+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:13.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:13.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:14.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:14.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:14.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:14.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:15.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:15.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:15.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:15.903+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:16.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:16.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:16.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:16.861+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:17.632 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:17.632+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:17.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:17.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:18.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:18.620+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:18.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:18.851+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:19.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:19.609+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:19.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:19.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:20.610 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:20.609+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:20.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:20.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:21.641 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:21.639+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:21.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:21.899+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:22.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:22.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:22.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:22.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:23.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:23.629+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:23.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:23.962+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:24.657 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:24.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:24.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:24.969+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:25.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:25.632+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:25.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:25.942+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:26.677 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:26.675+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:26.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:26.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:27.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:27.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:27.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:27.877+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:28.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:28.682+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:28.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:28.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:29.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:29.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:29.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:29.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:30.764 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:30.762+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:30.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:30.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:31.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:31.732+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:31.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:31.876+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:32.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:32.780+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:32.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:32.901+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:33.755 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:33.754+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:33.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:33.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:34.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:34.752+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:34.866 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:34.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:35.726 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:35.725+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:35.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:35.830+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:36.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:36.732+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:36.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:36.851+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:37.703 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:37.702+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:37.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:37.846+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:38.734 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:38.732+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:38.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:38.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:39.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:39.738+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:39.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:39.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:40.738 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:40.736+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:40.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:40.824+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:41.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:41.758+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:41.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:41.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:42.715 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:42.714+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:42.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:42.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:43.743 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:43.742+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:43.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:43.834+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:44.728 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:44.727+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:44.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:44.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:45.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:45.699+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:45.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:45.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:46.687 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:46.685+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:46.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:46.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:47.727 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:47.726+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:47.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:47.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:48.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:48.684+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:48.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:48.895+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:49.649 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:49.648+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:49.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:49.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:50.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:50.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:50.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:50.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:51.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:51.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:51.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:51.905+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:52.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:52.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:52.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:52.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:53.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:53.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:53.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:53.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:54.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:54.499+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:54.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:54.942+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:55.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:55.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:55.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:55.956+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:56.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:56.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:56.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:56.957+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:57.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:57.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:57.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:57.995+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:58.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:58.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:59.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:35:59.004+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:35:59.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:35:59.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:00.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:00.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:00.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:00.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:01.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:01.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:01.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:01.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:02.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:02.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:02.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:02.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:03.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:03.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:03.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:03.555+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:04.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:04.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:04.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:04.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:05.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:05.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:05.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:05.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:06.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:06.034+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:06.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:06.565+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:07.000 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:06.999+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:07.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:07.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:08.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:08.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:08.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:08.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:09.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:09.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:09.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:09.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:10.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:10.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:10.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:10.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:11.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:11.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:11.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:11.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:12.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:12.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:12.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:12.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:13.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:13.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:13.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:13.461+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:14.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:14.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:14.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:14.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:15.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:15.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:15.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:15.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:16.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:16.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:16.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:16.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:17.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:17.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:17.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:17.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:18.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:18.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:18.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:18.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:19.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:19.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:19.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:19.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:20.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:20.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:20.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:20.554+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:21.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:21.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:21.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:21.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:22.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:22.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:22.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:22.605+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:23.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:23.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:23.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:23.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:23.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:23.989+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:24.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:24.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:25.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:25.029+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:25.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:25.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:26.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:26.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:26.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:26.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:27.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:27.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:27.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:27.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:28.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:28.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:28.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:28.607+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:29.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:29.091+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:29.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:29.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:30.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:30.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:30.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:30.546+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:31.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:31.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:31.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:31.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:32.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:32.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:32.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:32.563+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:33.176 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:33.174+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:33.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:33.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:34.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:34.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:34.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:34.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:35.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:35.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:35.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:35.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:36.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:36.131+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:36.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:36.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:37.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:37.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:37.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:37.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:38.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:38.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:38.586 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:38.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:39.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:39.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:39.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:39.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:40.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:40.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:40.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:40.601+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:41.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:41.176+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:41.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:41.608+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:42.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:42.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:42.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:42.596+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:43.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:43.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:43.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:43.594+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:44.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:44.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:44.611 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:44.610+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:45.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:45.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:45.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:45.647+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:46.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:46.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:46.618 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:46.618+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:47.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:47.115+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:47.639 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:47.638+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:48.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:48.109+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:48.656 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:48.655+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:49.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:49.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:49.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:49.705+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:50.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:50.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:50.702 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:50.700+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:51.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:51.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:51.670 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:51.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:52.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:52.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:52.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:52.677+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:53.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:53.091+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:53.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:53.705+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:54.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:54.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:54.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:54.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:55.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:55.057+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:55.682 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:55.680+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:56.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:56.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:56.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:56.720+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:57.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:57.000+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:57.736 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:57.735+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:58.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:58.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:58.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:58.731+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:59.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:36:59.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:36:59.688 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:36:59.687+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:00.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:00.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:00.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:00.644+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:00.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:00.995+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:01.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:01.694+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:02.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:02.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:02.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:02.695+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:03.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:03.068+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:03.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:03.695+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:04.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:04.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:04.721 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:04.720+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:05.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:05.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:05.689 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:05.687+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:06.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:06.080+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:06.720 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:06.718+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:07.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:07.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:07.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:07.720+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:08.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:08.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:08.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:08.705+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:09.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:09.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:09.737 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:09.733+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:10.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:10.026+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:10.737 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:10.736+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:11.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:11.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:11.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:11.696+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:12.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:12.017+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:12.651 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:12.649+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:12.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:12.993+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:13.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:13.696+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:14.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:14.011+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:14.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:14.743+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:15.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:15.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:15.715 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:15.714+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:16.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:16.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:16.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:16.693+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:16.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:16.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:17.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:17.670+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:17.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:17.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:18.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:18.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:18.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:18.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:19.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:19.644+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:19.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:19.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:20.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:20.658+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:20.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:20.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:21.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:21.671+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:21.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:21.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:22.676 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:22.676+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:22.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:22.914+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:23.682 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:23.681+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:23.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:23.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:24.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:24.657+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:24.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:24.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:25.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:25.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:25.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:25.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:26.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:26.602+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:26.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:26.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:27.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:27.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:27.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:27.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:28.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:28.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:28.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:28.915+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:29.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:29.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:29.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:29.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:30.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:30.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:30.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:30.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:31.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:31.448+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:31.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:31.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:32.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:32.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:32.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:32.862+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:33.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:33.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:33.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:33.837+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:34.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:34.414+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:34.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:34.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:35.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:35.423+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:35.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:35.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:36.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:36.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:36.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:36.911+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:37.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:37.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:37.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:37.889+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:38.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:38.423+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:38.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:38.911+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:39.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:39.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:39.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:39.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:40.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:40.443+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:40.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:40.995+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:41.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:41.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:41.973 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:41.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:42.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:42.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:42.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:42.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:43.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:43.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:43.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:43.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:44.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:44.378+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:44.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:44.948+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:45.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:45.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:45.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:45.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:46.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:46.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:46.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:46.928+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:47.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:47.473+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:47.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:47.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:48.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:48.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:48.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:48.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:49.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:49.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:49.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:49.951+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:50.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:50.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:50.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:50.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:51.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:51.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:51.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:51.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:52.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:52.509+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:52.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:52.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:53.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:53.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:53.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:53.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:54.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:54.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:54.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:54.930+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:55.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:55.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:55.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:55.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:56.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:56.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:56.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:56.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:57.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:57.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:58.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:58.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:58.597 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:58.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:59.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:37:59.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:37:59.617 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:37:59.615+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:00.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:00.008+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:00.663 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:00.661+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:01.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:01.027+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:01.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:01.632+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:01.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:01.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:02.649 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:02.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:02.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:02.937+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:03.684 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:03.684+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:03.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:03.914+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:04.694 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:04.694+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:04.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:04.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:05.717 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:05.717+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:05.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:05.951+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:06.719 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:06.718+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:06.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:06.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:07.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:07.733+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:07.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:07.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:08.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:08.752+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:08.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:08.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:09.720 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:09.719+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:09.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:09.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:10.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:10.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:10.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:10.993+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:11.630 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:11.630+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:12.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:12.042+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:12.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:12.654+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:13.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:13.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:13.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:13.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:14.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:14.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:14.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:14.690+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:14.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:14.989+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:15.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:15.654+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:15.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:15.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:16.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:16.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:17.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:17.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:17.669 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:17.667+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:18.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:18.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:18.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:18.622+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:19.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:19.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:19.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:19.644+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:20.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:20.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:20.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:20.650+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:21.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:21.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:21.650 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:21.648+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:22.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:22.014+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:22.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:22.641+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:22.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:22.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:23.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:23.600+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:23.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:23.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:24.612 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:24.610+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:24.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:24.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:25.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:25.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:25.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:25.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:26.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:26.605+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:26.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:26.924+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:27.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:27.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:27.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:27.948+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:28.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:28.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:28.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:28.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:29.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:29.532+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:29.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:29.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:30.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:30.574+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:30.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:30.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:31.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:31.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:31.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:31.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:32.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:32.556+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:33.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:33.017+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:33.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:33.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:33.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:33.986+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:34.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:34.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:34.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:34.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:35.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:35.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:35.975 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:35.973+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:36.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:36.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:36.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:36.936+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:37.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:37.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:37.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:37.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:38.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:38.515+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:38.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:38.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:39.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:39.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:39.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:39.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:40.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:40.437+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:40.945 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:40.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:41.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:41.421+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:41.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:41.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:42.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:42.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:42.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:42.922+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:43.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:43.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:43.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:43.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:44.421 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:44.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:44.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:44.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:45.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:45.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:45.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:45.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:46.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:46.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:46.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:46.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:47.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:47.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:47.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:47.951+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:48.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:48.499+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:48.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:48.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:49.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:49.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:49.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:49.918+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:50.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:50.459+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:50.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:50.896+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:51.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:51.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:51.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:51.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:52.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:52.415+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:52.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:52.855+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:53.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:53.367+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:53.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:53.868+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:54.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:54.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:54.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:54.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:55.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:55.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:55.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:55.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:56.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:56.459+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:56.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:56.864+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:57.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:57.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:57.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:57.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:58.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:58.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:58.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:58.863+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:59.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:38:59.509+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:38:59.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:38:59.885+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:00.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:00.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:00.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:00.930+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:01.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:01.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:01.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:01.910+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:02.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:02.438+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:02.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:02.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:03.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:03.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:03.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:03.860+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:04.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:04.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:04.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:04.892+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:05.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:05.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:05.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:05.903+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:06.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:06.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:06.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:06.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:07.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:07.475+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:07.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:07.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:08.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:08.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:08.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:08.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:09.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:09.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:09.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:09.879+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:10.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:10.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:10.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:10.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:11.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:11.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:11.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:11.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:12.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:12.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:12.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:12.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:13.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:13.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:13.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:13.879+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:14.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:14.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:14.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:14.882+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:15.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:15.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:15.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:15.901+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:16.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:16.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:16.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:16.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:17.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:17.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:17.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:17.897+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:18.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:18.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:18.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:18.859+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:19.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:19.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:19.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:19.832+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:20.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:20.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:20.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:20.829+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:21.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:21.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:21.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:21.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:22.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:22.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:22.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:22.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:23.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:23.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:23.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:23.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:24.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:24.516+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:24.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:24.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:25.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:25.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:25.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:25.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:26.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:26.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:26.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:26.930+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:27.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:27.561+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:27.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:27.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:28.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:28.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:28.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:28.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:29.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:29.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:29.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:29.897+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:30.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:30.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:30.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:30.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:31.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:31.575+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:31.811 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:31.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:32.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:32.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:32.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:32.806+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:33.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:33.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:33.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:33.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:34.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:34.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:34.829 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:34.828+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:35.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:35.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:35.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:35.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:36.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:36.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:36.820 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:36.819+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:37.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:37.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:37.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:37.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:38.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:38.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:38.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:38.844+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:39.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:39.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:39.811 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:39.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:40.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:40.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:40.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:40.851+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:41.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:41.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:41.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:41.809+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:42.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:42.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:42.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:42.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:43.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:43.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:43.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:43.795+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:44.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:44.503+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:44.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:44.776+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:45.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:45.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:45.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:45.789+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:46.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:46.421+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:46.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:46.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:47.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:47.389+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:47.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:47.792+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:48.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:48.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:48.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:48.749+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:49.409 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:49.407+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:49.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:49.730+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:50.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:50.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:50.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:50.691+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:51.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:51.379+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:51.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:51.687+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:52.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:52.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:52.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:52.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:53.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:53.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:53.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:53.693+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:54.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:54.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:54.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:54.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:55.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:55.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:55.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:55.767+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:56.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:56.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:56.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:56.794+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:57.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:57.351+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:57.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:57.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:58.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:58.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:58.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:58.778+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:59.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:39:59.294+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:39:59.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:39:59.746+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:00.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:00.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:00.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:00.778+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:01.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:01.295+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:01.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:01.827+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:02.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:02.334+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:02.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:02.846+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:03.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:03.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:03.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:03.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:04.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:04.353+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:04.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:04.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:05.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:05.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:05.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:05.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:06.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:06.277+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:06.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:06.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:07.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:07.258+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:07.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:07.839+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:08.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:08.281+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:08.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:08.807+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:09.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:09.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:09.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:09.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:10.330 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:10.328+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:10.866 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:10.864+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:11.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:11.353+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:11.817 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:11.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:12.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:12.344+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:12.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:12.806+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:13.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:13.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:13.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:13.789+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:14.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:14.325+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:14.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:14.761+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:15.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:15.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:15.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:15.803+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:16.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:16.278+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:16.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:16.851+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:17.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:17.273+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:17.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:17.868+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:18.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:18.273+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:18.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:18.861+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:19.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:19.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:19.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:19.897+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:20.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:20.232+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:20.895 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:20.895+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:21.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:21.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:21.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:21.877+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:22.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:22.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:22.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:22.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:23.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:23.207+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:23.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:23.859+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:24.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:24.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:24.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:24.824+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:25.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:25.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:25.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:25.843+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:26.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:26.219+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:26.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:26.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:27.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:27.230+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:27.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:27.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:28.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:28.266+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:28.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:28.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:29.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:29.218+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:29.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:29.851+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:30.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:30.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:30.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:30.900+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:31.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:31.284+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:31.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:31.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:32.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:32.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:32.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:32.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:33.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:33.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:33.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:33.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:34.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:34.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:34.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:34.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:35.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:35.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:35.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:35.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:36.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:36.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:36.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:36.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:37.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:37.246+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:37.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:37.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:38.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:38.226+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:38.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:38.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:39.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:39.251+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:39.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:39.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:40.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:40.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:40.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:40.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:41.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:41.253+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:42.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:42.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:42.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:42.207+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:43.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:43.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:43.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:43.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:44.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:44.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:44.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:44.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:45.138 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:45.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:45.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:45.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:46.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:46.092+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:46.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:46.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:47.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:47.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:47.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:47.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:48.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:48.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:48.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:48.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:49.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:49.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:49.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:49.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:49.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:49.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:50.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:50.129+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:51.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:51.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:51.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:51.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:52.029 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:52.027+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:52.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:52.108+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:53.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:53.016+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:53.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:53.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:54.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:53.999+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:54.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:54.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:54.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:54.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:55.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:55.054+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:55.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:55.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:56.041 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:56.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:56.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:56.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:57.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:57.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:57.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:57.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:58.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:58.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:58.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:40:58.998+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:40:59.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:40:59.077+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:00.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:00.007+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:00.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:00.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:00.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:00.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:01.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:01.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:01.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:01.911+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:02.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:02.124+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:02.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:02.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:03.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:03.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:03.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:03.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:04.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:04.047+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:04.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:04.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:05.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:05.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:05.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:05.889+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:05.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:05.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:06.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:06.864+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:07.008 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:07.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:07.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:07.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:08.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:08.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:08.037 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T05:41:08.036+0000 7efd7fbac700 0 -- 172.21.15.134:0/875767599 >> [v2:172.21.15.134:6808/114487,v1:172.21.15.134:6809/114487] conn(0x5578b402aec0 msgr2=0x7efd640887b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-12-06T05:41:08.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:08.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:08.986 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:08.984+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:09.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:09.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:10.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:10.003+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:10.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:10.991+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:11.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:11.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:12.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:12.010+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:12.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:12.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:12.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:12.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:13.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:13.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:13.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:13.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:13.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:13.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:15.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:15.003+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:15.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:15.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:16.052 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:16.050+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:16.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:16.053+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:17.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:17.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:17.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:17.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:18.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:18.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:18.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:18.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:18.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:18.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:19.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:19.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:19.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:19.928+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:20.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:20.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:20.899 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:20.897+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:21.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:21.026+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:21.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:21.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:22.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:22.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:22.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:22.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:23.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:23.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:23.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:23.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:24.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:24.008+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:24.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:24.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:24.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:24.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:26.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:25.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:26.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:26.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:26.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:26.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:27.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:27.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:27.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:27.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:27.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:27.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:28.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:28.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:29.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:29.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:29.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:29.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:30.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:30.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:30.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:30.924+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:31.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:31.055+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:31.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:31.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:32.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:32.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:32.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:32.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:32.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:32.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:33.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:33.950+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:33.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:33.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:34.948 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:34.946+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:34.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:34.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:35.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:35.940+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:35.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:35.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:36.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:36.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:37.005 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:37.003+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:37.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:37.911+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:38.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:38.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:38.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:38.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:39.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:39.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:39.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:39.888+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:40.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:40.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:40.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:40.916+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:41.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:41.044+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:41.910 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:41.910+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:42.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:42.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:42.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:42.956+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:43.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:43.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:43.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:43.923+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:44.033 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:44.032+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:44.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:44.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:45.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:45.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:45.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:45.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:46.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:46.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:46.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:46.908+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:47.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:47.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:47.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:47.894+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:48.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:48.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:48.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:48.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:49.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:49.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:49.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:49.922+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:50.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:50.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:50.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:50.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:51.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:51.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:51.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:51.944+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:52.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:52.115+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:52.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:52.921+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:53.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:53.131+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:53.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:53.914+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:54.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:54.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:54.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:54.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:55.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:55.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:55.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:55.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:56.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:56.062+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:56.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:56.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:57.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:57.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:57.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:57.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:58.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:58.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:58.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:58.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:59.184 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:41:59.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:41:59.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:41:59.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:00.220 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:00.218+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:00.910 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:00.908+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:01.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:01.254+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:01.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:01.923+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:02.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:02.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:02.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:02.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:03.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:03.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:03.887 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:03.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:04.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:04.260+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:04.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:04.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:05.261 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:05.259+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:05.881 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:05.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:06.240 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:06.238+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:06.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:06.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:07.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:07.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:07.891 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:07.890+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:08.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:08.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:08.868 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:08.866+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:09.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:09.205+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:09.899 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:09.898+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:10.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:10.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:10.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:10.870+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:11.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:11.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:11.833 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:11.832+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:12.171 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:12.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:12.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:12.846+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:13.175 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:13.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:13.828 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:13.826+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:14.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:14.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:14.819 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:14.818+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:15.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:15.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:15.847 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:15.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:16.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:16.145+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:16.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:16.838+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:17.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:17.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:17.881 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:17.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:18.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:18.179+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:18.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:18.894+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:19.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:19.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:19.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:19.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:20.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:20.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:20.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:20.910+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:21.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:21.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:21.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:21.869+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:22.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:22.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:22.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:22.839+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:23.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:23.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:23.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:23.889+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:24.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:24.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:24.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:24.902+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:25.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:25.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:25.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:25.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:26.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:26.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:26.881 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:26.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:27.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:27.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:27.868 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:27.868+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:28.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:28.299+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:28.844 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:28.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:29.267 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:29.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:29.821 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:29.821+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:30.240 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:30.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:30.833 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:30.830+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:31.270 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:31.269+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:31.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:31.840+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:32.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:32.311+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:32.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:32.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:33.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:33.349+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:33.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:33.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:34.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:34.397+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:34.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:34.923+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:35.386 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:35.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:35.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:35.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:36.426 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:36.424+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:36.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:36.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:37.469 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:37.467+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:37.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:37.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:38.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:38.476+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:38.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:38.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:39.450 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:39.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:39.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:39.940+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:40.402 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:40.400+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:40.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:40.956+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:41.375 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:41.373+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:41.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:41.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:42.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:42.401+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:42.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:42.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:43.387 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:43.385+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:43.878 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:43.877+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:44.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:44.425+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:44.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:44.862+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:45.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:45.451+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:45.833 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:45.832+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:46.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:46.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:46.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:46.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:47.468 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:47.466+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:47.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:47.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:48.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:48.451+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:48.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:48.894+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:49.459 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:49.457+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:49.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:49.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:50.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:50.502+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:50.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:50.910+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:51.464 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:51.463+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:51.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:51.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:52.461 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:52.459+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:52.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:52.959+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:53.450 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:53.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:53.972 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:53.971+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:54.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:54.455+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:55.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:55.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:55.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:55.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:56.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:56.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:56.526 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:56.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:56.986 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:56.984+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:57.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:57.491+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:57.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:57.959+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:58.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:58.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:58.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:58.980+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:59.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:42:59.555+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:42:59.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:42:59.938+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:00.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:00.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:00.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:00.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:01.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:01.538+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:01.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:01.910+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:02.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:02.535+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:02.913 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:02.912+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:03.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:03.569+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:03.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:03.943+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:04.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:04.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:04.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:04.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:05.514 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:05.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:05.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:05.987+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:06.553 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:06.552+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:07.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:07.006+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:07.538 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:07.536+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:08.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:08.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:08.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:08.566+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:09.029 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:09.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:09.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:09.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:10.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:10.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:10.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:10.591+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:11.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:11.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:11.545 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:11.544+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:12.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:12.090+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:12.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:12.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:13.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:13.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:13.538 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:13.538+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:14.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:14.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:14.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:14.565+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:15.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:15.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:15.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:15.557+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:16.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:16.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:16.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:16.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:17.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:17.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:17.512 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:17.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:18.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:18.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:18.501 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:18.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:19.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:19.086+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:19.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:19.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:20.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:20.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:20.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:20.455+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:21.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:21.090+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:21.418 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:21.416+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:22.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:22.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:22.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:22.438+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:23.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:23.119+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:23.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:23.456+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:24.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:24.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:24.491 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:24.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:25.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:25.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:25.463 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:25.462+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:26.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:26.089+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:26.498 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:26.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:27.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:27.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:27.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:27.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:28.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:28.047+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:28.475 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:28.473+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:29.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:29.017+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:29.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:29.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:29.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:29.981+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:30.523 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:30.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:30.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:30.978+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:31.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:31.478+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:31.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:31.935+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:32.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:32.478+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:32.903 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:32.902+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:33.465 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:33.463+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:33.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:33.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:34.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:34.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:34.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:34.953+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:35.464 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:35.463+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:35.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:35.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:36.509 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:36.508+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:37.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:37.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:37.509 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:37.508+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:38.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:38.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:38.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:38.504+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:39.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:39.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:39.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:39.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:40.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:40.017+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:40.547 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:40.546+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:41.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:41.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:41.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:41.520+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:42.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:42.023+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:42.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:42.498+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:43.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:43.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:43.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:43.459+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:44.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:43.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:44.464 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:44.462+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:44.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:44.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:45.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:45.415+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:45.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:45.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:46.410 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:46.408+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:47.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:47.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:47.439 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:47.437+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:48.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:48.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:48.409 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:48.408+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:49.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:49.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:49.448 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:49.447+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:50.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:50.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:50.463 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:50.461+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:51.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:51.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:51.489 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:51.489+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:52.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:52.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:52.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:52.502+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:53.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:53.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:53.505 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:53.505+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:54.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:54.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:54.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:54.478+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:55.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:55.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:55.458 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:55.457+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:56.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:56.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:56.422 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:56.421+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:57.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:57.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:57.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:57.456+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:58.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:58.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:58.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:58.502+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:59.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:43:59.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:43:59.484 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:43:59.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:00.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:00.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:00.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:00.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:01.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:01.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:01.434 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:01.433+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:02.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:02.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:02.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:02.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:03.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:03.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:03.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:03.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:04.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:04.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:04.425 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:04.424+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:05.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:05.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:05.461 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:05.460+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:06.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:06.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:06.423 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:06.421+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:07.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:07.130+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:07.451 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:07.449+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:08.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:08.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:08.412 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:08.410+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:09.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:09.068+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:09.400 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:09.399+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:10.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:10.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:10.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:10.391+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:11.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:11.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:11.439 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:11.438+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:12.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:12.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:12.476 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:12.474+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:13.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:13.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:13.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:13.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:14.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:14.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:14.449 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:14.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:15.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:15.181+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:15.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:15.418+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:16.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:16.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:16.409 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:16.408+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:17.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:17.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:17.383 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:17.381+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:18.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:18.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:18.420 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:18.419+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:19.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:19.201+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:19.373 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:19.372+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:20.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:20.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:20.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:20.401+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:21.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:21.195+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:21.421 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:21.418+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:22.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:22.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:22.387 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:22.385+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:23.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:23.212+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:23.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:23.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:24.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:24.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:24.329 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:24.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:25.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:25.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:25.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:25.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:26.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:26.212+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:26.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:26.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:27.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:27.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:27.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:27.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:28.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:28.275+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:28.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:28.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:29.242 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:29.240+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:29.312 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:29.305+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:30.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:30.222+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:30.316 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:30.314+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:31.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:31.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:31.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:31.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:32.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:32.272+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:32.349 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:32.348+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:33.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:33.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:33.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:33.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:34.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:34.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:34.386 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:34.384+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:35.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:35.218+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:35.385 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:35.384+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:36.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:36.240+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:36.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:36.388+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:37.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:37.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:37.387 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:37.387+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:38.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:38.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:38.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:38.353+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:39.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:39.267+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:39.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:39.403+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:40.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:40.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:40.408 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:40.408+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:41.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:41.357+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:41.434 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:41.434+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:42.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:42.357+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:42.397 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:42.396+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:43.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:43.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:43.363 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:43.363+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:44.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:44.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:44.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:44.365+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:45.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:45.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:45.402 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:45.402+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:46.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:46.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:46.373 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:46.372+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:47.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:47.323+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:47.397 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:47.395+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:48.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:48.294+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:48.392 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:48.390+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:49.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:49.285+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:49.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:49.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:50.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:50.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:50.392 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:50.390+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:51.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:51.257+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:51.414 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:51.413+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:52.226 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:52.224+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:52.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:52.460+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:53.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:53.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:53.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:53.493+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:54.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:54.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:54.484 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:54.482+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:55.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:55.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:55.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:55.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:56.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:56.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:56.505 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:56.503+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:57.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:57.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:57.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:57.468+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:58.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:58.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:58.489 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:58.487+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:59.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:44:59.267+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:44:59.491 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:44:59.489+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:00.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:00.311+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:00.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:00.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:01.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:01.270+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:01.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:01.517+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:02.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:02.285+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:02.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:02.468+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:03.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:03.267+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:03.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:03.443+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:04.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:04.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:04.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:04.470+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:05.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:05.266+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:05.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:05.520+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:06.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:06.293+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:06.525 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:06.524+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:07.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:07.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:07.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:07.495+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:08.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:08.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:08.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:08.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:09.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:09.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:09.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:09.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:10.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:10.285+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:10.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:10.563+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:11.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:11.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:11.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:11.598+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:12.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:12.281+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:12.621 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:12.619+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:13.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:13.273+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:13.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:13.649+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:14.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:14.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:14.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:14.660+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:15.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:15.303+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:15.656 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:15.654+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:16.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:16.315+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:16.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:16.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:17.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:17.330+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:17.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:17.697+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:18.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:18.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:18.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:18.652+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:19.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:19.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:19.605 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:19.605+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:20.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:20.204+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:20.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:20.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:21.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:21.189+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:21.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:21.528+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:22.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:22.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:22.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:22.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:23.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:23.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:23.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:23.581+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:24.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:24.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:24.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:24.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:25.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:25.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:25.523 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:25.522+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:26.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:26.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:26.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:26.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:27.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:27.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:27.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:27.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:28.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:28.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:28.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:28.547+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:29.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:29.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:29.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:29.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:30.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:30.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:30.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:30.555+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:31.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:31.078+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:31.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:31.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:32.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:32.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:32.512 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:32.510+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:33.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:33.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:33.507 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:33.505+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:34.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:34.068+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:34.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:34.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:35.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:35.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:35.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:35.513+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:36.029 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:36.027+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:36.467 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:36.465+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:36.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:36.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:37.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:37.495+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:38.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:38.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:38.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:38.497+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:39.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:39.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:39.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:39.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:40.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:40.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:40.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:40.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:41.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:41.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:41.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:41.476+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:42.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:42.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:42.501 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:42.499+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:43.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:43.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:43.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:43.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:44.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:44.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:44.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:44.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:45.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:45.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:45.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:45.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:46.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:46.028+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:46.458 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:46.457+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:46.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:46.982+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:47.430 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:47.429+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:47.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:47.970+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:48.383 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:48.381+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:48.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:48.975+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:49.432 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:49.430+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:49.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:49.950+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:50.418 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:50.416+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:50.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:50.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:51.429 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:51.427+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:51.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:51.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:52.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:52.468+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:52.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:52.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:53.461 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:53.459+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:53.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:53.957+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:54.465 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:54.464+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:54.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:54.957+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:55.467 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:55.465+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:55.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:55.922+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:56.438 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:56.436+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:56.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:56.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:57.469 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:57.467+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:57.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:57.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:58.431 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:58.429+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:58.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:58.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:59.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:45:59.425+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:45:59.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:45:59.993+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:00.429 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:00.427+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:00.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:00.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:01.435 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:01.434+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:01.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:01.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:02.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:02.474+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:02.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:02.978+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:03.495 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:03.495+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:04.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:04.015+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:04.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:04.470+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:05.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:05.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:05.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:05.510+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:06.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:06.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:06.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:06.477+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:07.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:07.069+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:07.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:07.502+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:08.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:08.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:08.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:08.510+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:09.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:09.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:09.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:09.485+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:10.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:10.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:10.469 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:10.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:11.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:11.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:11.437 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:11.436+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:12.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:12.096+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:12.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:12.462+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:13.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:13.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:13.477 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:13.476+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:14.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:14.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:14.488 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:14.486+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:15.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:15.079+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:15.449 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:15.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:16.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:16.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:16.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:16.460+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:17.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:17.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:17.461 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:17.460+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:18.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:18.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:18.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:18.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:18.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:18.992+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:19.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:19.504+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:19.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:19.970+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:20.489 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:20.487+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:20.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:20.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:21.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:21.483+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:21.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:21.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:22.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:22.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:23.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:23.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:23.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:23.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:24.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:24.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:24.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:24.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:25.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:25.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:25.488 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:25.487+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:26.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:26.069+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:26.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:26.494+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:27.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:27.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:27.475 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:27.473+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:28.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:28.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:28.516 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:28.515+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:29.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:29.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:29.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:29.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:30.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:30.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:30.519 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:30.517+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:31.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:31.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:31.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:31.560+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:32.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:32.048+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:32.514 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:32.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:33.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:33.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:33.505 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:33.504+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:34.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:34.032+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:34.466 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:34.465+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:35.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:35.025+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:35.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:35.451+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:35.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:35.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:36.495 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:36.493+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:36.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:36.978+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:37.446 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:37.445+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:37.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:37.946+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:38.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:38.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:38.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:38.980+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:39.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:39.470+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:39.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:39.948+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:40.430 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:40.428+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:40.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:40.967+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:41.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:41.412+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:41.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:41.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:42.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:42.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:43.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:43.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:43.441 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:43.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:43.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:43.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:44.418 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:44.417+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:45.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:45.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:45.433 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:45.432+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:46.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:46.039+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:46.435 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:46.434+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:47.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:47.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:47.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:47.403+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:48.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:48.095+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:48.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:48.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:49.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:49.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:49.380 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:49.379+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:50.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:50.100+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:50.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:50.419+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:51.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:51.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:51.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:51.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:52.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:52.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:52.445 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:52.444+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:53.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:53.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:53.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:53.444+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:54.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:54.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:54.491 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:54.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:55.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:55.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:55.513 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:55.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:56.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:56.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:56.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:56.531+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:57.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:57.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:57.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:57.555+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:58.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:58.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:58.527 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:58.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:59.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:46:59.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:46:59.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:46:59.542+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:00.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:00.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:00.500 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:00.499+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:01.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:01.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:01.487 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:01.486+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:02.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:02.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:02.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:02.458+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:03.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:03.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:03.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:03.416+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:04.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:04.167+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:04.459 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:04.458+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:05.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:05.169+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:05.445 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:05.444+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:06.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:06.204+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:06.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:06.426+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:07.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:07.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:07.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:07.410+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:08.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:08.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:08.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:08.402+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:09.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:09.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:09.422 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:09.420+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:10.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:10.214+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:10.406 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:10.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:11.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:11.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:11.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:11.401+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:12.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:12.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:12.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:12.377+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:13.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:13.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:13.330 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:13.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:14.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:14.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:14.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:14.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:15.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:15.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:15.388 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:15.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:16.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:16.159+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:16.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:16.387+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:17.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:17.198+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:17.367 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:17.366+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:18.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:18.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:18.329 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:18.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:19.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:19.198+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:19.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:19.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:20.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:20.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:20.346 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:20.344+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:21.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:21.275+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:21.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:21.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:22.303 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:22.301+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:22.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:22.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:23.276 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:23.274+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:23.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:23.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:24.271 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:24.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:24.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:24.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:25.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:25.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:25.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:25.381+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:26.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:26.362+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:26.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:26.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:27.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:27.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:27.397 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:27.396+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:28.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:28.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:28.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:28.377+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:29.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:29.333+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:29.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:29.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:30.362 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:30.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:30.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:30.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:31.399 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:31.398+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:31.415 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:31.414+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:32.432 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:32.431+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:32.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:32.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:33.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:33.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:33.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:33.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:34.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:34.453+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:34.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:34.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:35.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:35.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:35.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:35.477+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:36.467 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:36.466+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:36.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:36.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:37.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:37.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:37.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:37.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:38.464 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:38.463+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:38.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:38.550+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:39.431 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:39.430+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:39.586 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:39.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:40.456 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:40.454+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:40.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:40.576+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:41.448 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:41.446+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:41.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:41.575+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:42.399 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:42.397+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:42.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:42.581+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:43.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:43.359+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:43.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:43.549+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:44.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:44.394+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:44.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:44.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:45.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:45.387+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:45.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:45.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:46.397 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:46.396+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:46.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:46.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:47.386 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:47.382+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:47.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:47.498+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:48.387 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:48.385+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:48.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:48.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:49.390 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:49.388+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:49.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:49.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:50.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:50.392+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:50.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:50.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:51.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:51.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:51.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:51.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:52.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:52.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:52.471 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:52.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:53.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:53.388+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:53.439 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:53.438+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:54.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:54.344+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:54.406 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:54.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:55.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:55.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:55.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:55.376+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:56.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:56.339+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:56.415 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:56.414+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:57.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:57.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:57.374 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:57.373+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:58.355 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:58.354+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:58.423 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:58.422+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:59.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:47:59.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:47:59.422 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:47:59.421+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:00.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:00.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:00.438 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:00.436+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:01.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:01.381+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:01.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:01.456+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:02.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:02.414+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:02.504 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:02.502+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:03.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:03.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:03.488 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:03.487+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:04.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:04.414+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:04.454 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:04.452+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:05.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:05.399+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:05.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:05.483+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:06.441 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:06.440+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:06.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:06.447+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:07.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:07.415+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:07.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:07.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:08.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:08.409+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:08.437 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:08.435+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:09.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:09.453+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:09.475 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:09.474+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:10.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:10.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:10.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:10.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:11.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:11.410+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:11.508 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:11.507+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:12.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:12.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:12.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:12.462+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:13.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:13.411+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:13.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:13.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:14.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:14.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:14.538 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:14.537+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:15.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:15.395+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:15.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:15.574+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:16.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:16.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:16.604 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:16.603+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:17.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:17.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:17.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:17.624+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:18.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:18.453+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:18.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:18.675+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:19.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:19.407+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:19.639 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:19.638+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:20.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:20.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:20.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:20.629+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:21.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:21.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:21.597 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:21.596+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:22.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:22.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:22.631 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:22.630+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:23.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:23.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:23.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:23.624+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:24.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:24.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:24.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:24.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:25.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:25.409+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:25.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:25.582+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:26.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:26.378+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:26.559 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:26.557+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:27.379 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:27.377+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:27.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:27.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:28.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:28.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:28.598 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:28.593+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:29.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:29.368+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:29.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:29.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:30.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:30.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:30.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:30.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:31.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:31.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:31.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:31.542+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:32.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:32.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:32.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:32.569+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:33.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:33.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:33.594 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:33.593+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:34.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:34.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:34.624 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:34.623+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:35.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:35.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:35.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:35.664+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:36.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:36.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:36.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:36.671+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:37.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:37.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:37.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:37.684+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:38.330 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:38.328+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:38.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:38.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:39.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:39.303+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:39.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:39.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:40.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:40.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:40.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:40.693+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:41.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:41.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:41.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:41.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:42.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:42.351+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:42.676 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:42.674+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:43.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:43.383+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:43.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:43.720+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:44.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:44.379+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:44.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:44.744+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:45.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:45.383+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:45.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:45.696+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:46.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:46.423+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:46.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:46.718+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:47.448 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:47.447+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:47.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:47.714+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:48.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:48.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:48.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:48.732+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:49.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:49.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:49.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:49.708+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:50.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:50.453+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:50.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:50.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:51.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:51.422+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:51.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:51.659+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:52.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:52.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:52.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:52.635+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:53.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:53.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:53.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:53.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:54.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:54.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:54.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:54.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:55.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:55.532+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:55.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:55.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:56.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:56.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:56.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:56.592+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:57.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:57.524+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:57.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:57.642+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:58.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:58.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:58.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:58.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:59.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:48:59.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:48:59.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:48:59.721+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:00.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:00.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:00.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:00.712+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:01.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:01.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:01.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:01.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:02.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:02.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:02.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:02.729+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:03.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:03.500+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:03.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:03.697+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:04.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:04.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:04.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:04.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:05.573 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:05.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:05.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:05.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:06.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:06.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:06.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:06.660+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:07.604 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:07.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:07.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:07.695+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:08.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:08.589+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:08.663 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:08.661+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:09.627 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:09.625+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:09.676 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:09.674+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:10.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:10.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:10.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:10.666+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:11.630 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:11.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:11.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:11.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:12.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:12.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:12.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:12.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:13.676 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:13.675+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:13.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:13.686+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:14.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:14.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:14.726 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:14.724+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:15.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:15.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:15.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:15.744+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:16.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:16.696+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:16.756 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:16.754+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:17.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:17.719+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:17.768 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:17.766+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:18.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:18.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:18.809 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:18.807+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:19.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:19.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:19.767 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:19.765+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:20.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:20.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:20.757 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:20.755+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:21.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:21.683+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:21.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:21.757+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:22.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:22.680+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:22.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:22.757+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:23.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:23.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:23.738 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:23.736+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:24.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:24.696+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:24.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:24.720+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:25.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:25.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:25.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:25.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:26.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:26.684+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:26.686 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:26.684+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:27.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:27.691+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:27.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:27.714+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:28.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:28.665+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:28.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:28.671+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:29.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:29.645+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:29.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:29.664+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:30.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:30.681+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:30.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:30.684+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:31.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:31.642+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:31.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:31.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:32.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:32.637+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:32.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:32.689+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:33.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:33.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:33.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:33.722+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:34.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:34.696+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:34.702 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:34.701+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:35.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:35.703+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:35.752 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:35.751+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:36.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:36.730+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:36.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:36.758+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:37.707 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:37.706+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:37.755 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:37.753+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:38.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:38.658+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:38.780 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:38.778+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:39.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:39.652+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:39.771 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:39.770+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:40.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:40.696+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:40.755 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:40.754+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:41.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:41.745+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:41.759 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:41.759+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:42.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:42.704+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:42.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:42.752+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:43.663 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:43.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:43.751 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:43.750+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:44.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:44.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:44.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:44.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:45.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:45.733+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:45.799 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:45.798+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:46.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:46.757+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:46.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:46.806+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:47.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:47.724+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:47.825 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:47.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:48.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:48.735+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:48.810 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:48.809+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:49.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:49.738+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:49.812 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:49.811+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:50.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:50.712+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:50.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:50.780+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:51.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:51.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:51.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:51.790+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:52.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:52.725+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:52.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:52.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:53.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:53.737+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:53.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:53.758+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:54.754 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:54.752+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:54.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:54.776+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:55.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:55.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:55.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:55.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:56.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:56.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:56.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:56.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:57.747 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:57.746+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:57.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:57.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:58.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:58.762+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:58.783 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:58.782+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:59.797 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:49:59.795+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:49:59.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:49:59.810+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:00.780 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:00.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:00.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:00.802+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:01.772 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:01.771+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:01.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:01.824+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:02.737 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:02.735+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:02.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:02.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:03.774 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:03.773+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:03.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:03.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:04.728 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:04.726+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:04.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:04.817+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:05.723 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:05.721+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:05.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:05.832+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:06.689 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:06.688+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:06.866 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:06.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:07.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:07.650+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:07.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:07.856+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:08.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:08.654+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:08.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:08.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:09.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:09.694+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:09.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:09.832+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:10.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:10.657+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:10.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:10.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:11.686 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:11.684+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:11.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:11.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:12.682 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:12.680+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:12.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:12.888+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:13.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:13.635+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:13.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:13.860+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:14.662 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:14.660+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:14.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:14.908+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:15.626 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:15.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:15.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:15.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:16.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:16.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:16.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:16.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:17.614 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:17.613+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:17.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:17.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:18.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:18.570+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:18.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:18.855+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:19.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:19.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:19.863 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:19.861+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:20.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:20.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:20.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:20.888+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:21.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:21.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:21.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:21.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:22.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:22.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:22.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:22.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:23.611 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:23.611+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:23.879 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:23.879+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:24.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:24.571+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:24.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:24.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:25.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:25.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:25.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:25.855+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:26.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:26.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:26.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:26.885+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:27.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:27.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:27.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:27.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:28.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:28.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:28.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:28.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:29.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:29.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:29.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:29.856+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:30.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:30.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:30.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:30.873+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:31.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:31.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:31.920 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:31.919+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:32.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:32.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:32.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:32.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:33.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:33.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:33.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:33.864+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:34.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:34.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:34.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:34.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:35.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:35.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:35.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:35.915+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:36.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:36.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:36.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:36.908+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:37.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:37.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:37.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:37.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:38.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:38.594+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:38.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:38.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:39.633 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:39.632+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:40.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:40.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:40.627 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:40.626+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:41.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:41.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:41.677 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:41.675+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:42.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:42.014+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:42.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:42.671+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:43.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:43.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:43.657 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:43.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:44.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:44.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:44.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:44.637+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:45.031 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:45.029+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:45.626 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:45.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:45.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:45.994+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:46.650 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:46.648+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:46.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:46.961+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:47.700 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:47.699+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:48.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:48.007+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:48.740 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:48.738+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:48.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:48.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:49.729 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:49.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:49.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:49.936+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:50.752 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:50.750+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:50.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:50.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:51.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:51.744+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:51.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:51.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:52.712 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:52.710+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:52.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:52.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:53.761 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:53.760+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:53.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:53.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:54.716 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:54.714+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:54.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:54.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:55.678 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:55.676+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:55.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:55.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:56.682 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:56.680+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:56.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:56.899+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:57.684 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:57.682+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:57.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:57.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:58.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:58.730+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:58.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:58.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:59.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:50:59.769+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:50:59.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:50:59.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:00.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:00.776+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:00.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:00.921+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:01.804 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:01.803+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:01.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:01.888+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:02.783 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:02.781+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:02.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:02.908+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:03.768 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:03.766+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:03.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:03.929+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:04.808 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:04.807+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:04.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:04.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:05.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:05.822+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:05.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:05.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:06.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:06.780+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:06.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:06.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:07.790 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:07.789+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:07.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:07.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:08.764 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:08.763+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:09.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:09.000+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:09.761 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:09.760+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:09.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:09.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:10.736 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:10.736+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:11.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:11.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:11.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:11.732+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:11.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:11.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:12.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:12.730+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:13.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:13.011+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:13.780 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:13.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:13.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:13.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:14.788 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:14.787+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:14.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:14.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:15.814 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:15.813+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:15.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:15.957+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:16.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:16.835+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:16.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:16.915+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:17.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:17.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:17.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:17.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:18.852 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:18.851+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:18.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:18.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:19.887 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:19.885+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:19.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:19.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:20.870 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:20.868+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:20.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:20.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:21.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:21.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:21.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:21.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:22.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:22.847+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:22.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:22.923+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:23.870 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:23.869+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:23.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:23.918+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:24.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:24.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:24.905 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:24.903+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:25.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:25.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:25.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:25.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:26.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:26.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:26.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:26.979+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:27.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:27.841+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:28.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:28.020+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:28.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:28.802+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:29.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:29.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:29.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:29.803+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:30.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:30.069+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:30.854 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:30.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:31.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:31.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:31.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:31.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:32.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:32.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:32.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:32.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:33.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:33.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:33.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:33.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:34.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:34.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:34.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:34.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:35.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:35.095+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:35.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:35.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:36.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:36.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:36.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:36.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:37.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:37.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:37.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:37.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:38.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:38.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:38.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:38.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:39.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:39.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:39.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:39.823+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:40.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:40.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:40.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:40.863+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:41.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:41.181+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:41.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:41.873+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:42.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:42.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:42.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:42.914+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:43.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:43.144+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:43.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:43.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:44.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:44.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:44.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:44.896+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:45.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:45.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:45.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:45.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:46.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:46.060+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:46.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:46.832+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:47.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:47.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:47.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:47.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:48.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:48.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:48.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:48.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:49.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:49.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:49.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:49.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:50.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:50.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:50.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:50.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:51.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:51.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:51.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:51.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:52.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:52.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:52.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:52.804+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:53.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:53.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:53.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:53.800+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:54.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:54.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:54.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:54.839+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:55.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:55.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:55.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:55.854+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:56.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:56.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:56.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:56.826+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:57.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:57.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:57.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:57.830+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:58.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:58.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:58.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:58.854+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:59.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:51:59.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:51:59.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:51:59.891+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:00.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:00.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:00.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:00.913+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:01.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:01.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:01.877 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:01.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:02.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:02.135+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:02.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:02.889+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:03.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:03.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:03.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:03.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:04.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:04.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:04.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:04.950+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:05.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:05.230+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:05.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:05.957+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:06.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:06.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:06.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:06.928+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:07.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:07.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:07.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:07.962+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:08.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:08.248+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:08.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:08.961+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:09.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:09.225+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:09.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:09.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:10.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:10.272+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:10.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:10.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:11.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:11.259+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:11.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:11.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:12.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:12.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:13.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:13.004+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:13.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:13.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:14.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:14.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:14.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:14.236+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:15.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:15.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:15.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:15.257+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:15.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:15.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:16.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:16.263+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:16.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:16.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:17.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:17.277+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:17.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:17.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:18.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:18.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:18.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:18.918+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:19.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:19.256+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:19.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:19.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:20.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:20.270+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:20.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:20.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:21.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:21.245+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:21.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:21.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:22.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:22.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:22.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:22.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:23.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:23.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:23.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:23.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:24.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:24.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:24.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:24.962+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:25.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:25.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:25.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:25.942+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:26.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:26.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:26.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:26.975+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:27.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:27.168+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:27.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:27.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:28.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:28.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:28.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:28.996+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:29.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:29.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:29.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:29.986+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:30.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:30.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:30.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:30.948+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:31.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:31.276+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:31.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:31.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:32.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:32.272+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:32.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:32.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:33.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:33.249+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:33.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:33.973+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:34.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:34.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:34.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:34.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:35.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:35.279+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:35.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:35.989+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:36.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:36.314+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:36.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:36.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:37.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:37.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:37.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:37.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:38.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:38.329+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:38.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:38.967+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:39.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:39.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:39.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:39.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:40.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:40.311+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:41.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:41.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:41.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:41.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:41.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:41.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:42.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:42.363+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:43.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:43.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:43.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:43.388+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:44.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:44.039+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:44.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:44.365+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:45.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:45.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:45.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:45.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:46.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:46.044+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:46.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:46.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:47.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:47.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:47.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:47.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:48.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:48.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:48.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:48.320+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:49.077 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:49.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:49.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:49.277+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:50.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:50.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:50.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:50.251+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:51.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:51.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:51.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:51.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:52.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:52.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:52.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:52.255+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:53.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:53.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:53.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:53.246+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:54.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:54.158+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:54.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:54.278+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:55.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:55.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:55.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:55.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:56.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:56.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:56.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:56.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:57.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:57.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:57.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:57.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:58.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:58.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:58.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:58.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:59.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:52:59.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:52:59.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:52:59.410+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:00.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:00.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:00.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:00.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:01.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:01.115+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:01.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:01.388+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:02.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:02.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:02.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:02.344+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:03.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:03.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:03.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:03.354+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:04.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:04.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:04.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:04.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:05.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:05.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:05.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:05.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:06.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:06.128+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:06.321 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:06.319+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:07.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:07.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:07.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:07.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:08.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:08.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:08.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:08.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:09.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:09.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:09.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:09.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:10.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:10.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:10.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:10.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:11.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:11.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:11.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:11.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:12.175 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:12.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:12.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:12.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:13.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:13.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:13.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:13.358+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:14.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:14.215+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:14.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:14.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:15.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:15.232+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:15.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:15.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:16.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:16.272+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:16.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:16.328+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:17.240 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:17.239+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:17.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:17.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:18.267 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:18.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:18.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:18.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:19.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:19.241+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:19.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:19.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:20.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:20.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:20.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:20.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:21.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:21.221+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:21.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:21.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:22.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:22.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:22.264 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:22.264+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:23.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:23.278+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:23.296 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:23.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:24.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:24.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:24.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:24.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:25.270 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:25.269+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:25.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:25.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:26.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:26.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:26.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:26.307+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:27.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:27.231+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:27.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:27.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:28.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:28.233+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:28.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:28.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:29.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:29.226+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:29.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:29.324+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:30.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:30.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:30.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:30.281+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:31.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:31.257+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:31.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:31.308+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:32.291 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:32.289+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:32.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:32.349+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:33.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:33.247+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:33.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:33.394+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:34.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:34.272+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:34.382 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:34.380+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:35.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:35.301+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:35.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:35.415+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:36.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:36.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:36.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:36.409+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:37.352 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:37.350+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:37.401 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:37.400+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:38.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:38.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:38.392 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:38.390+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:39.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:39.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:39.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:39.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:40.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:40.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:40.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:40.320+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:41.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:41.302+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:41.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:41.331+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:42.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:42.266+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:42.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:42.285+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:43.307 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:43.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:43.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:43.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:44.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:44.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:44.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:44.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:45.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:45.324+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:45.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:45.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:46.329 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:46.327+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:46.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:46.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:47.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:47.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:47.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:47.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:48.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:48.250+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:48.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:48.356+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:49.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:49.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:49.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:49.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:50.229 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:50.228+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:50.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:50.353+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:51.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:51.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:51.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:51.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:52.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:52.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:52.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:52.362+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:53.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:53.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:53.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:53.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:54.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:54.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:54.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:54.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:55.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:55.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:55.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:55.303+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:56.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:56.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:56.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:56.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:57.178 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:57.176+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:57.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:57.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:58.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:58.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:58.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:58.323+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:59.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:53:59.126+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:53:59.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:53:59.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:00.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:00.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:00.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:00.330+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:01.184 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:01.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:01.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:01.329+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:02.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:02.218+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:02.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:02.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:03.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:03.211+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:03.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:03.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:04.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:04.234+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:04.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:04.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:05.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:05.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:05.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:05.307+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:06.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:06.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:06.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:06.353+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:07.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:07.204+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:07.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:07.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:08.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:08.163+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:08.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:08.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:09.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:09.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:09.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:09.279+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:10.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:10.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:10.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:10.319+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:11.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:11.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:11.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:11.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:12.052 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:12.050+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:12.330 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:12.328+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:13.053 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:13.051+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:13.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:13.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:14.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:14.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:14.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:14.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:15.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:15.097+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:15.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:15.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:16.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:16.057+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:16.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:16.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:17.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:17.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:17.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:17.294+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:17.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:17.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:18.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:18.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:19.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:19.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:19.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:19.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:20.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:20.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:20.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:20.270+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:21.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:21.038+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:21.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:21.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:21.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:21.996+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:22.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:22.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:23.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:23.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:23.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:23.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:24.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:24.030+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:24.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:24.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:25.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:25.052+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:25.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:25.288+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:26.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:26.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:26.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:26.315+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:27.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:27.030+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:27.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:27.319+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:28.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:28.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:28.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:28.329+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:29.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:29.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:29.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:29.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:30.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:30.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:30.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:30.307+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:31.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:31.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:31.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:31.287+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:32.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:32.067+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:32.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:32.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:33.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:33.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:33.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:33.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:34.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:34.121+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:34.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:34.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:35.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:35.089+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:35.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:35.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:36.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:36.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:36.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:36.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:37.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:37.155+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:37.396 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:37.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:38.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:38.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:38.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:38.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:39.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:39.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:39.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:39.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:40.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:40.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:40.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:40.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:41.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:41.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:41.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:41.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:42.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:42.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:42.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:42.369+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:43.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:43.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:43.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:43.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:44.253 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:44.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:44.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:44.354+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:45.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:45.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:45.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:45.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:46.269 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:46.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:46.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:46.275+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:47.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:47.293+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:47.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:47.325+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:48.281 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:48.280+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:48.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:48.323+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:49.319 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:49.318+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:49.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:49.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:50.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:50.297+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:50.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:50.319+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:51.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:51.273+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:51.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:51.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:52.242 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:52.241+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:52.322 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:52.321+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:53.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:53.215+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:53.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:53.304+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:54.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:54.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:54.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:54.340+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:55.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:55.259+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:55.357 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:55.356+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:56.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:56.272+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:56.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:56.362+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:57.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:57.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:57.360 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:57.357+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:58.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:58.293+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:58.355 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:58.354+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:59.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:54:59.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:54:59.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:54:59.345+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:00.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:00.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:00.390 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:00.388+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:01.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:01.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:01.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:01.387+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:02.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:02.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:02.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:02.411+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:03.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:03.328+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:03.369 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:03.368+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:04.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:04.348+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:04.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:04.350+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:05.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:05.314+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:05.345 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:05.343+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:06.318 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:06.317+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:06.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:06.334+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:07.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:07.319+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:07.325 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:07.324+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:08.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:08.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:08.354 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:08.352+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:09.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:09.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:09.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:09.324+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:10.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:10.293+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:10.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:10.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:11.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:11.313+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:11.344 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:11.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:12.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:12.271+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:12.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:12.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:13.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:13.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:13.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:13.352+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:14.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:14.287+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:14.339 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:14.338+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:15.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:15.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:15.330 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:15.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:16.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:16.272+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:16.334 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:16.333+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:17.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:17.284+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:17.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:17.364+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:18.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:18.238+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:18.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:18.410+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:19.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:19.207+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:19.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:19.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:20.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:20.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:20.402 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:20.400+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:21.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:21.177+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:21.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:21.394+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:22.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:22.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:22.368 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:22.366+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:23.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:23.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:23.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:23.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:24.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:24.185+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:24.362 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:24.360+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:25.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:25.208+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:25.381 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:25.380+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:26.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:26.180+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:26.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:26.403+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:27.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:27.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:27.414 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:27.414+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:28.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:28.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:28.410 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:28.410+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:29.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:29.220+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:29.422 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:29.422+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:30.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:30.182+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:30.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:30.391+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:31.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:31.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:31.399 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:31.398+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:32.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:32.117+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:32.414 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:32.413+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:33.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:33.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:33.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:33.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:34.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:34.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:34.392 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:34.392+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:35.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:35.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:35.374 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:35.373+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:36.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:36.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:36.410 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:36.410+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:37.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:37.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:37.379 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:37.378+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:38.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:38.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:38.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:38.376+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:39.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:39.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:39.425 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:39.424+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:40.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:40.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:40.442 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:40.441+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:41.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:41.001+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:41.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:41.461+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:42.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:42.031+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:42.449 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:42.447+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:43.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:43.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:43.446 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:43.445+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:44.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:44.089+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:44.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:44.396+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:45.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:45.069+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:45.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:45.377+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:46.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:46.096+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:46.379 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:46.377+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:47.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:47.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:47.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:47.425+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:48.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:48.055+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:48.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:48.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:49.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:49.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:49.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:49.483+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:50.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:50.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:50.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:50.508+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:50.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:50.980+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:51.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:51.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:51.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:51.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:52.544 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:52.543+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:53.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:53.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:53.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:53.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:53.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:53.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:54.546 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:54.544+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:55.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:55.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:55.509 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:55.507+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:56.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:56.030+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:56.526 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:56.524+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:57.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:57.015+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:57.528 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:57.526+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:58.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:58.045+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:58.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:58.569+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:59.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:55:59.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:55:59.614 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:55:59.613+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:00.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:00.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:00.651 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:00.650+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:01.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:01.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:01.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:01.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:02.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:02.108+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:02.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:02.637+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:03.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:03.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:03.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:03.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:04.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:04.095+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:04.563 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:04.562+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:05.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:05.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:05.559 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:05.558+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:06.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:06.129+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:06.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:06.571+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:07.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:07.169+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:07.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:07.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:08.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:08.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:08.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:08.610+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:09.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:09.136+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:09.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:09.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:10.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:10.103+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:10.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:10.574+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:11.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:11.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:11.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:11.587+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:12.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:12.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:12.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:12.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:13.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:13.068+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:13.594 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:13.593+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:14.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:14.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:14.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:14.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:14.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:14.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:15.552 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:15.551+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:15.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:15.995+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:16.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:16.502+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:16.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:16.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:17.514 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:17.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:17.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:17.987+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:18.490 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:18.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:19.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:19.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:19.526 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:19.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:20.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:20.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:20.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:20.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:21.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:21.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:21.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:21.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:21.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:21.982+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:22.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:22.520+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:23.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:23.033+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:23.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:23.504+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:24.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:24.011+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:24.467 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:24.465+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:24.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:24.978+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:25.445 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:25.444+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:26.008 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:26.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:26.426 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:26.424+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:27.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:27.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:27.438 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:27.437+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:28.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:28.020+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:28.475 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:28.474+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:29.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:29.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:29.432 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:29.431+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:30.027 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:30.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:30.420 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:30.418+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:31.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:31.017+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:31.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:31.455+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:32.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:32.065+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:32.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:32.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:33.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:33.060+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:33.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:33.470+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:34.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:34.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:34.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:34.481+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:35.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:35.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:35.479 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:35.477+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:36.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:36.030+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:36.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:36.520+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:37.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:37.015+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:37.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:37.495+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:38.008 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:38.006+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:38.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:38.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:38.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:38.971+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:39.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:39.497+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:39.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:39.932+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:40.487 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:40.485+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:40.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:40.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:41.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:41.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:41.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:41.909+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:42.523 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:42.522+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:42.879 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:42.877+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:43.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:43.553+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:43.889 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:43.888+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:44.594 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:44.592+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:44.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:44.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:45.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:45.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:45.904 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:45.902+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:46.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:46.590+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:46.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:46.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:47.583 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:47.581+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:47.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:47.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:48.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:48.609+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:48.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:48.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:49.639 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:49.637+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:49.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:49.892+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:50.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:50.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:50.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:50.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:51.656 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:51.655+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:51.851 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:51.849+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:52.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:52.631+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:52.838 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:52.836+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:53.616 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:53.615+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:53.852 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:53.852+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:54.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:54.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:54.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:54.871+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:55.616 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:55.615+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:55.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:55.839+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:56.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:56.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:56.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:56.887+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:57.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:57.643+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:57.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:57.938+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:58.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:58.622+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:58.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:58.957+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:59.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:56:59.654+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:56:59.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:56:59.975+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:00.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:00.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:00.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:00.994+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:01.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:01.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:02.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:02.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:02.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:02.731+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:03.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:03.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:03.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:03.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:04.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:04.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:04.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:04.696+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:05.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:05.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:05.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:05.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:06.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:06.011+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:06.707 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:06.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:07.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:07.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:07.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:07.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:08.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:08.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:08.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:08.723+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:08.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:08.995+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:09.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:09.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:10.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:10.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:10.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:10.677+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:11.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:11.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:11.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:11.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:11.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:11.958+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:12.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:12.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:12.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:12.930+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:13.616 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:13.614+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:13.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:13.930+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:14.576 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:14.574+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:14.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:14.900+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:15.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:15.542+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:15.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:15.905+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:16.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:16.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:16.889 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:16.887+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:17.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:17.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:17.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:17.934+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:18.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:18.553+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:18.965 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:18.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:19.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:19.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:19.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:19.943+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:20.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:20.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:20.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:20.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:21.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:21.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:22.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:22.021+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:22.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:22.597+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:23.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:23.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:23.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:23.559+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:23.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:23.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:24.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:24.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:24.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:24.982+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:25.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:25.564+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:25.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:25.959+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:26.565 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:26.563+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:26.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:26.948+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:27.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:27.568+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:27.965 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:27.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:28.617 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:28.615+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:28.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:28.949+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:29.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:29.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:30.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:30.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:30.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:30.617+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:31.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:31.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:31.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:31.598+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:32.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:32.006+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:32.607 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:32.605+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:33.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:33.031+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:33.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:33.621+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:34.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:34.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:34.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:34.600+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:35.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:35.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:35.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:35.642+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:36.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:36.018+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:36.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:36.661+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:37.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:37.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:37.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:37.643+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:38.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:38.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:38.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:38.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:39.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:39.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:39.604 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:39.603+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:40.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:40.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:40.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:40.586+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:41.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:41.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:41.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:41.577+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:42.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:42.016+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:42.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:42.574+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:42.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:42.982+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:43.547 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:43.546+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:43.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:43.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:44.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:44.505+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:44.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:44.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:45.521 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:45.520+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:45.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:45.928+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:46.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:46.530+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:46.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:46.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:47.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:47.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:47.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:47.995+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:48.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:48.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:48.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:48.974+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:49.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:49.546+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:49.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:49.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:50.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:50.564+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:50.917 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:50.916+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:51.608 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:51.606+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:51.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:51.905+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:52.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:52.633+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:52.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:52.895+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:53.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:53.653+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:53.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:53.903+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:54.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:54.704+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:54.878 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:54.877+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:55.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:55.679+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:55.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:55.870+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:56.645 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:56.643+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:56.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:56.883+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:57.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:57.635+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:57.860 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:57.859+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:58.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:58.587+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:58.905 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:58.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:59.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:57:59.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:57:59.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:57:59.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:00.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:00.558+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:00.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:00.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:01.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:01.571+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:01.926 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:01.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:02.594 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:02.592+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:02.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:02.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:03.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:03.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:03.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:03.958+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:04.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:04.568+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:04.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:04.935+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:05.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:05.594+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:05.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:05.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:06.604 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:06.603+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:06.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:06.948+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:07.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:07.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:07.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:07.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:08.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:08.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:09.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:08.999+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:09.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:09.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:10.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:10.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:10.504 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:10.502+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:11.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:11.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:11.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:11.547+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:12.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:12.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:12.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:12.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:13.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:13.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:13.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:13.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:14.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:14.062+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:14.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:14.562+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:15.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:15.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:15.520 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:15.518+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:16.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:16.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:16.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:16.559+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:17.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:17.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:17.598 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:17.596+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:18.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:18.135+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:18.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:18.556+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:19.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:19.169+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:19.513 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:19.511+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:20.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:20.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:20.508 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:20.507+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:21.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:21.259+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:21.513 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:21.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:22.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:22.295+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:22.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:22.517+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:23.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:23.288+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:23.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:23.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:24.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:24.333+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:24.505 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:24.504+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:25.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:25.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:25.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:25.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:26.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:26.307+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:26.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:26.579+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:27.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:27.325+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:27.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:27.605+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:28.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:28.356+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:28.600 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:28.600+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:29.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:29.339+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:29.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:29.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:30.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:30.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:30.558 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:30.558+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:31.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:31.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:31.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:31.605+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:32.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:32.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:32.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:32.597+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:33.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:33.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:33.645 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:33.644+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:34.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:34.202+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:34.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:34.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:35.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:35.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:35.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:35.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:36.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:36.140+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:36.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:36.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:37.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:37.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:37.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:37.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:38.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:38.135+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:38.639 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:38.638+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:39.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:39.130+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:39.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:39.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:40.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:40.170+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:40.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:40.600+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:41.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:41.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:41.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:41.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:42.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:42.177+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:42.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:42.639+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:43.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:43.181+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:43.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:43.617+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:44.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:44.165+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:44.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:44.611+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:45.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:45.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:45.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:45.630+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:46.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:46.198+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:46.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:46.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:47.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:47.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:47.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:47.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:48.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:48.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:48.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:48.679+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:49.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:49.179+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:49.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:49.708+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:50.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:50.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:50.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:50.731+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:51.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:51.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:51.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:51.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:52.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:52.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:52.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:52.712+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:53.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:53.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:53.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:53.724+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:54.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:54.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:54.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:54.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:55.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:55.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:55.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:55.779+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:56.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:56.125+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:56.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:56.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:57.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:57.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:57.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:57.772+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:58.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:58.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:58.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:58.776+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:59.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:58:59.196+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:58:59.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:58:59.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:00.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:00.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:00.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:00.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:01.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:01.266+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:01.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:01.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:02.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:02.314+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:02.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:02.808+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:03.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:03.267+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:03.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:03.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:04.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:04.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:04.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:04.859+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:05.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:05.295+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:05.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:05.876+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:06.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:06.289+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:06.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:06.883+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:07.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:07.253+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:07.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:07.924+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:08.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:08.221+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:08.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:08.951+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:09.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:09.270+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:09.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:09.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:10.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:10.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:10.945 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:10.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:11.332 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:11.331+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:11.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:11.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:12.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:12.325+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:12.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:12.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:13.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:13.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:13.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:13.892+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:14.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:14.336+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:14.863 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:14.862+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:15.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:15.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:15.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:15.869+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:16.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:16.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:16.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:16.905+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:17.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:17.275+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:17.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:17.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:18.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:18.294+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:18.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:18.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:19.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:19.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:19.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:19.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:20.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:20.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:20.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:20.972+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:21.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:21.354+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:21.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:21.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:22.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:22.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:22.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:22.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:23.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:23.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:23.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:23.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:24.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:24.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:24.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:24.969+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:25.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:25.357+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:25.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:25.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:26.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:26.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:27.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:27.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:27.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:27.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:28.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:28.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:28.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:28.361+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:29.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:29.032+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:29.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:29.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:30.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:30.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:30.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:30.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:31.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:31.016+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:31.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:31.273+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:31.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:31.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:32.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:32.260+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:33.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:33.001+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:33.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:33.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:34.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:34.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:34.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:34.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:35.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:35.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:35.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:35.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:36.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:36.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:36.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:36.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:37.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:37.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:37.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:37.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:38.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:38.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:38.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:38.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:39.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:39.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:39.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:39.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:40.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:40.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:40.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:40.177+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:41.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:41.042+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:41.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:41.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:42.052 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:42.050+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:42.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:42.169+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:43.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:43.045+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:43.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:43.130+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:44.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:44.029+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:44.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:44.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:45.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:45.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:45.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:45.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:46.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:46.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:46.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:46.146+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:47.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:47.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:47.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:47.099+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:48.053 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:48.052+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:48.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:48.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:49.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:49.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:49.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:49.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:50.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:50.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:50.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:50.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:51.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:51.026+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:51.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:51.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:52.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:52.039+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:52.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:52.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:53.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:53.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:53.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:53.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:54.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:54.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:54.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:54.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:55.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:55.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:55.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:55.168+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:56.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:56.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:56.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:56.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:57.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:57.119+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:57.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:57.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:58.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:58.080+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:58.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:58.163+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:59.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T05:59:59.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T05:59:59.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T05:59:59.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:00.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:00.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:00.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:00.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:01.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:01.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:01.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:01.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:02.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:02.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:02.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:02.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:03.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:03.052+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:03.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:03.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:04.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:04.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:04.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:04.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:05.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:05.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:05.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:05.077+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:06.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:06.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:06.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:06.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:07.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:07.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:07.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:07.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:07.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:07.994+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:08.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:08.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:09.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:09.016+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:09.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:09.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:10.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:10.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:10.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:10.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:10.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:10.991+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:11.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:11.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:11.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:11.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:12.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:12.059+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:12.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:12.957+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:13.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:13.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:13.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:13.993+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:14.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:14.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:14.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:14.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:14.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:14.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:15.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:15.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:15.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:15.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:16.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:16.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:16.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:16.987+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:17.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:17.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:17.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:17.976+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:18.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:18.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:18.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:18.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:19.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:19.980+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:20.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:20.015+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:20.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:20.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:21.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:21.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:21.910 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:21.908+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:22.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:22.052+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:22.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:22.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:23.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:23.031+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:23.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:23.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:23.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:23.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:24.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:24.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:24.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:24.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:25.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:25.923+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:26.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:26.034+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:26.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:26.971+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:27.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:27.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:27.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:27.932+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:28.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:28.007+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:28.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:28.980+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:28.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:28.993+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:29.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:29.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:29.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:29.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:30.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:30.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:31.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:31.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:31.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:31.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:32.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:32.030+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:32.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:32.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:33.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:33.045+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:33.891 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:33.890+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:34.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:34.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:34.913 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:34.912+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:34.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:34.989+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:35.869 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:35.868+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:35.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:35.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:36.845 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:36.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:36.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:36.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:37.865 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:37.865+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:37.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:37.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:38.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:38.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:38.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:38.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:39.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:39.921+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:39.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:39.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:40.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:40.896+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:40.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:40.949+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:41.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:41.858+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:41.904 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:41.903+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:42.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:42.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:42.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:42.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:43.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:43.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:43.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:43.977+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:44.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:44.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:44.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:44.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:45.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:45.835+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:45.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:45.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:46.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:46.794+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:46.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:46.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:47.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:47.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:47.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:47.925+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:48.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:48.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:48.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:48.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:49.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:49.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:49.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:49.923+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:50.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:50.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:50.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:50.961+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:51.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:51.802+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:51.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:51.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:52.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:52.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:52.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:52.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:53.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:53.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:53.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:53.950+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:54.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:54.719+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:54.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:54.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:55.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:55.688+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:56.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:56.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:56.701 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:56.699+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:56.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:56.988+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:57.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:57.670+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:57.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:57.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:58.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:58.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:58.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:00:58.979+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:00:59.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:00:59.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:00.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:00.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:00.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:00.701+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:01.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:01.062+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:01.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:01.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:02.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:02.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:02.701 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:02.700+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:02.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:02.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:03.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:03.697+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:04.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:04.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:04.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:04.660+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:05.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:05.022+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:05.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:05.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:06.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:06.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:06.624 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:06.623+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:07.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:07.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:07.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:07.658+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:08.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:08.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:08.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:08.654+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:09.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:09.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:09.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:09.683+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:10.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:10.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:10.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:10.671+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:11.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:11.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:11.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:11.670+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:12.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:12.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:12.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:12.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:12.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:12.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:13.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:13.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:14.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:14.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:14.601 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:14.600+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:15.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:15.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:15.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:15.648+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:16.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:16.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:16.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:16.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:17.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:17.048+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:17.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:17.732+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:18.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:18.011+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:18.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:18.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:19.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:19.021+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:19.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:19.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:20.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:20.033+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:20.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:20.724+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:21.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:21.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:21.738 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:21.737+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:22.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:22.003+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:22.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:22.716+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:22.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:22.977+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:23.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:23.686+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:23.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:23.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:24.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:24.688+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:24.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:24.948+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:25.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:25.643+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:25.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:25.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:26.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:26.610+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:27.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:27.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:27.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:27.608+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:28.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:28.066+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:28.624 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:28.622+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:29.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:29.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:29.615 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:29.613+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:30.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:30.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:30.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:30.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:31.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:31.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:31.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:31.644+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:32.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:32.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:32.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:32.673+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:33.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:33.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:33.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:33.680+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:34.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:34.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:34.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:34.709+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:35.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:35.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:35.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:35.695+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:36.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:36.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:36.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:36.670+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:37.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:37.241+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:37.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:37.664+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:38.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:38.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:38.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:38.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:39.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:39.180+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:39.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:39.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:40.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:40.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:40.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:40.665+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:41.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:41.182+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:41.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:41.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:42.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:42.168+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:42.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:42.693+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:43.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:43.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:43.656 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:43.654+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:44.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:44.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:44.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:44.643+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:45.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:45.119+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:45.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:45.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:46.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:46.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:46.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:46.703+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:47.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:47.055+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:47.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:47.745+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:48.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:48.031+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:48.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:48.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:49.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:48.999+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:49.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:49.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:49.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:49.958+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:50.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:50.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:50.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:50.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:51.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:51.760+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:51.915 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:51.913+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:52.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:52.772+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:52.887 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:52.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:53.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:53.767+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:53.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:53.887+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:54.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:54.766+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:54.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:54.838+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:55.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:55.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:55.830 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:55.828+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:56.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:56.748+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:56.857 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:56.856+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:57.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:57.789+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:57.822 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:57.821+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:58.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:58.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:58.868 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:58.867+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:59.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:01:59.803+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:01:59.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:01:59.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:00.829 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:00.828+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:00.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:00.832+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:01.854 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:01.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:01.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:01.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:02.875 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:02.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:02.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:02.888+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:03.841 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:03.840+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:03.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:03.923+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:04.793 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:04.792+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:04.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:04.937+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:05.763 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:05.762+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:05.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:05.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:06.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:06.797+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:06.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:06.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:07.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:07.835+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:07.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:07.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:08.875 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:08.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:08.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:08.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:09.844 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:09.842+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:09.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:09.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:10.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:10.825+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:10.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:10.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:11.831 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:11.830+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:11.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:11.915+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:12.799 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:12.798+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:12.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:12.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:13.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:13.760+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:13.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:13.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:14.763 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:14.761+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:14.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:14.950+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:15.747 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:15.745+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:15.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:15.948+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:16.717 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:16.715+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:16.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:16.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:17.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:17.721+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:17.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:17.923+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:18.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:18.767+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:18.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:18.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:19.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:19.722+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:19.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:19.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:20.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:20.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:20.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:20.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:21.776 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:21.774+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:21.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:21.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:22.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:22.757+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:22.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:22.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:23.715 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:23.713+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:23.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:23.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:24.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:24.731+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:24.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:24.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:25.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:25.700+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:25.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:25.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:26.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:26.662+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:26.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:26.924+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:27.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:27.705+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:27.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:27.930+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:28.711 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:28.708+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:28.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:28.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:29.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:29.696+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:30.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:30.001+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:30.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:30.743+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:31.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:31.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:31.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:31.704+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:32.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:32.032+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:32.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:32.700+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:33.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:33.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:33.708 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:33.706+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:34.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:34.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:34.755 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:34.753+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:35.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:35.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:35.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:35.780+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:36.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:36.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:36.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:36.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:37.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:37.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:37.792 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:37.790+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:38.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:38.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:38.809 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:38.808+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:39.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:39.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:39.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:39.778+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:40.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:40.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:40.794 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:40.792+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:41.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:41.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:41.822 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:41.821+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:42.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:42.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:42.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:42.861+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:43.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:43.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:43.822 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:43.822+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:44.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:44.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:44.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:44.815+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:45.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:45.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:45.800 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:45.799+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:46.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:46.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:46.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:46.777+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:47.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:47.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:47.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:47.741+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:48.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:48.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:48.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:48.738+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:49.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:49.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:49.729 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:49.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:50.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:50.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:50.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:50.744+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:51.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:51.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:51.703 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:51.702+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:52.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:52.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:52.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:52.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:53.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:53.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:53.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:53.682+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:54.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:54.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:54.682 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:54.680+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:55.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:55.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:55.732 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:55.730+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:56.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:56.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:56.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:56.742+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:57.225 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:57.223+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:57.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:57.693+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:58.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:58.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:58.721 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:58.719+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:59.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:02:59.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:02:59.735 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:02:59.733+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:00.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:00.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:00.743 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:00.741+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:01.223 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:01.221+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:01.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:01.769+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:02.197 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:02.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:02.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:02.729+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:03.225 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:03.223+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:03.774 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:03.772+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:04.232 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:04.231+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:04.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:04.740+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:05.251 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:05.249+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:05.792 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:05.790+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:06.205 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:06.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:06.792 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:06.790+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:07.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:07.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:07.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:07.821+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:08.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:08.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:08.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:08.776+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:09.220 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:09.218+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:09.810 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:09.809+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:10.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:10.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:10.820 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:10.818+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:11.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:11.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:11.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:11.778+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:12.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:12.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:12.817 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:12.815+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:13.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:13.249+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:13.856 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:13.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:14.205 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:14.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:14.818 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:14.816+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:15.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:15.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:15.853 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:15.851+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:16.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:16.236+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:16.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:16.874+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:17.282 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:17.281+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:17.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:17.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:18.307 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:18.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:18.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:18.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:19.327 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:19.325+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:19.918 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:19.916+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:20.324 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:20.323+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:20.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:20.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:21.345 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:21.343+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:21.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:21.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:22.343 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:22.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:22.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:22.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:23.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:23.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:23.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:23.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:24.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:24.324+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:24.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:24.885+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:25.313 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:25.312+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:25.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:25.894+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:26.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:26.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:26.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:26.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:27.322 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:27.321+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:27.868 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:27.867+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:28.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:28.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:28.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:28.884+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:29.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:29.388+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:29.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:29.910+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:30.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:30.412+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:30.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:30.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:31.418 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:31.418+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:31.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:31.949+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:32.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:32.459+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:32.915 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:32.914+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:33.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:33.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:33.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:33.945+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:34.400 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:34.399+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:34.918 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:34.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:35.450 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:35.449+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:35.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:35.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:36.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:36.409+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:36.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:36.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:37.388 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:37.387+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:37.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:37.979+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:38.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:38.347+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:39.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:38.999+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:39.324 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:39.322+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:39.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:39.972+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:40.291 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:40.290+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:41.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:41.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:41.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:41.245+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:42.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:42.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:42.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:42.265+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:43.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:43.048+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:43.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:43.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:44.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:44.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:44.270 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:44.269+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:45.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:45.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:45.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:45.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:46.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:46.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:46.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:46.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:46.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:46.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:47.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:47.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:47.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:47.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:48.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:48.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:48.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:48.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:49.149 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:49.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:49.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:49.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:50.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:50.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:50.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:50.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:51.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:51.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:51.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:51.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:52.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:52.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:53.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:53.020+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:53.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:53.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:54.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:54.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:54.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:54.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:55.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:55.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:55.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:55.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:56.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:56.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:56.205 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:56.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:57.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:57.054+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:57.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:57.225+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:58.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:58.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:58.255 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:58.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:59.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:03:59.066+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:03:59.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:03:59.263+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:00.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:00.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:00.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:00.271+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:01.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:01.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:01.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:01.283+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:02.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:02.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:02.317 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:02.315+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:03.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:03.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:03.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:03.299+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:04.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:04.180+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:04.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:04.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:05.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:05.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:05.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:05.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:06.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:06.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:06.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:06.256+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:07.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:07.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:07.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:07.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:08.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:08.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:08.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:08.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:09.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:09.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:09.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:09.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:10.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:10.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:10.290 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:10.289+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:11.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:11.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:11.245 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:11.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:12.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:12.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:12.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:12.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:13.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:13.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:13.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:13.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:14.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:14.115+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:14.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:14.227+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:15.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:15.130+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:15.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:15.262+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:16.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:16.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:16.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:16.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:17.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:17.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:17.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:17.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:18.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:18.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:18.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:18.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:19.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:19.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:19.264 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:19.263+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:20.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:20.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:20.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:20.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:21.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:21.150+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:21.318 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:21.316+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:22.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:22.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:22.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:22.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:23.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:23.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:23.279 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:23.278+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:24.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:24.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:24.285 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:24.283+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:25.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:25.144+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:25.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:25.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:26.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:26.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:26.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:26.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:27.199 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:27.197+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:27.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:27.215+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:28.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:28.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:28.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:28.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:29.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:29.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:29.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:29.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:30.215 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:30.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:30.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:30.217+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:31.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:31.236+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:31.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:31.239+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:32.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:32.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:32.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:32.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:33.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:33.159+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:33.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:33.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:34.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:34.179+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:34.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:34.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:35.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:35.167+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:35.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:35.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:36.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:36.192+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:36.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:36.209+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:37.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:37.177+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:37.232 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:37.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:38.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:38.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:38.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:38.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:39.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:39.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:39.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:39.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:40.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:40.136+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:40.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:40.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:41.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:41.119+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:41.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:41.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:42.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:42.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:42.255 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:42.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:43.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:43.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:43.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:43.288+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:44.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:44.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:44.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:44.320+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:45.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:45.182+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:45.331 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:45.329+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:46.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:46.196+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:46.306 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:46.304+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:47.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:47.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:47.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:47.351+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:48.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:48.234+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:48.356 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:48.354+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:49.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:49.264+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:49.360 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:49.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:50.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:50.266+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:50.369 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:50.367+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:51.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:51.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:51.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:51.393+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:52.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:52.307+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:52.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:52.375+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:53.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:53.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:53.363 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:53.362+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:54.291 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:54.290+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:54.381 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:54.378+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:55.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:55.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:55.379 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:55.379+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:56.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:56.339+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:56.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:56.418+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:57.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:57.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:57.467 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:57.466+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:58.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:58.377+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:58.456 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:58.455+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:59.409 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:04:59.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:04:59.498 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:04:59.497+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:00.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:00.437+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:00.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:00.473+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:01.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:01.422+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:01.455 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:01.454+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:02.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:02.384+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:02.424 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:02.423+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:03.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:03.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:03.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:03.401+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:04.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:04.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:04.430 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:04.428+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:05.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:05.288+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:05.390 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:05.388+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:06.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:06.253+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:06.345 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:06.343+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:07.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:07.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:07.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:07.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:08.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:08.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:08.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:08.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:09.246 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:09.244+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:09.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:09.312+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:10.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:10.201+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:10.267 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:10.265+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:11.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:11.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:11.251 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:11.249+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:12.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:12.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:12.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:12.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:13.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:13.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:13.281 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:13.279+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:14.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:14.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:14.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:14.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:15.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:15.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:15.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:15.331+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:16.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:16.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:16.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:16.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:17.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:17.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:17.344 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:17.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:18.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:18.150+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:18.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:18.374+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:19.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:19.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:19.383 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:19.381+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:20.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:20.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:20.431 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:20.429+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:21.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:21.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:21.446 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:21.445+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:22.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:22.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:22.458 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:22.456+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:23.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:23.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:23.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:23.470+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:24.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:24.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:24.448 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:24.446+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:25.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:25.211+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:25.458 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:25.456+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:26.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:26.226+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:26.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:26.468+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:27.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:27.238+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:27.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:27.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:28.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:28.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:28.514 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:28.513+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:29.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:29.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:29.541 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:29.539+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:30.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:30.180+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:30.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:30.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:31.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:31.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:31.528 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:31.526+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:32.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:32.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:32.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:32.566+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:33.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:33.215+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:33.608 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:33.606+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:34.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:34.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:34.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:34.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:35.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:35.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:35.658 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:35.657+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:36.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:36.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:36.633 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:36.632+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:37.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:37.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:37.633 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:37.633+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:38.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:38.195+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:38.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:38.671+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:39.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:39.199+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:39.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:39.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:40.151 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:40.150+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:40.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:40.660+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:41.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:41.130+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:41.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:41.697+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:42.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:42.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:42.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:42.729+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:43.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:43.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:43.720 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:43.719+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:44.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:44.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:44.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:44.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:45.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:45.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:45.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:45.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:46.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:46.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:46.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:46.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:47.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:47.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:47.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:47.726+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:48.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:48.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:48.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:48.710+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:49.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:49.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:49.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:49.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:50.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:50.028+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:50.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:50.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:51.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:51.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:51.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:51.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:52.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:52.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:52.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:52.679+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:53.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:53.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:53.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:53.723+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:54.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:54.124+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:54.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:54.744+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:55.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:55.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:55.724 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:55.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:56.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:56.117+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:56.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:56.735+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:57.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:57.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:57.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:57.773+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:58.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:58.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:58.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:58.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:59.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:05:59.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:05:59.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:05:59.731+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:00.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:00.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:00.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:00.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:01.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:01.236+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:01.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:01.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:02.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:02.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:02.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:02.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:03.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:03.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:03.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:03.836+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:04.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:04.279+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:04.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:04.791+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:05.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:05.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:05.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:05.746+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:06.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:06.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:06.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:06.703+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:07.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:07.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:07.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:07.714+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:08.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:08.308+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:08.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:08.750+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:09.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:09.351+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:09.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:09.778+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:10.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:10.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:10.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:10.802+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:11.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:11.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:11.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:11.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:12.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:12.350+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:12.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:12.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:13.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:13.374+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:13.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:13.829+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:14.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:14.367+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:14.829 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:14.827+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:15.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:15.383+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:15.879 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:15.877+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:16.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:16.336+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:16.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:16.885+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:17.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:17.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:17.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:17.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:18.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:18.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:18.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:18.846+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:19.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:19.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:19.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:19.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:20.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:20.415+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:20.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:20.909+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:21.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:21.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:21.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:21.922+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:22.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:22.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:22.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:22.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:23.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:23.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:23.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:23.837+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:24.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:24.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:24.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:24.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:25.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:25.377+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:25.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:25.846+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:26.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:26.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:26.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:26.844+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:27.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:27.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:27.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:27.804+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:28.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:28.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:28.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:28.756+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:29.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:29.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:29.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:29.716+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:30.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:30.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:30.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:30.668+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:31.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:31.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:31.639 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:31.637+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:32.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:32.379+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:32.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:32.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:33.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:33.396+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:33.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:33.712+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:34.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:34.351+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:34.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:34.707+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:35.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:35.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:35.707 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:35.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:36.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:36.270+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:36.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:36.657+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:37.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:37.246+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:37.648 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:37.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:38.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:38.215+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:38.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:38.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:39.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:39.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:39.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:39.707+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:40.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:40.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:40.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:40.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:41.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:41.138+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:41.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:41.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:42.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:42.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:42.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:42.623+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:43.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:43.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:43.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:43.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:44.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:44.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:44.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:44.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:45.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:45.079+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:45.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:45.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:46.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:46.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:46.615 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:46.613+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:47.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:47.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:47.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:47.565+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:48.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:48.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:48.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:48.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:49.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:49.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:49.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:49.610+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:50.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:50.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:50.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:50.633+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:51.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:51.148+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:51.609 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:51.607+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:52.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:52.196+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:52.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:52.641+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:53.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:53.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:53.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:53.665+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:54.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:54.207+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:54.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:54.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:55.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:55.180+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:55.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:55.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:56.226 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:56.224+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:56.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:56.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:57.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:57.246+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:57.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:57.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:58.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:58.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:58.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:58.815+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:59.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:06:59.225+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:06:59.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:06:59.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:00.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:00.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:00.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:00.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:01.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:01.180+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:01.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:01.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:02.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:02.140+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:02.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:02.883+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:03.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:03.165+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:03.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:03.903+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:04.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:04.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:04.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:04.861+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:05.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:05.195+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:05.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:05.881+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:06.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:06.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:06.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:06.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:07.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:07.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:07.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:07.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:08.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:08.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:08.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:08.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:09.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:09.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:09.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:09.905+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:10.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:10.108+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:10.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:10.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:11.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:11.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:11.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:11.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:12.099 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:12.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:13.033 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:13.032+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:13.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:13.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:14.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:14.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:14.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:14.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:15.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:15.062+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:15.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:15.174+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:16.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:16.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:16.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:16.170+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:17.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:17.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:17.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:17.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:18.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:18.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:18.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:18.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:19.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:19.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:19.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:19.201+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:20.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:20.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:20.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:20.223+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:21.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:21.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:21.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:21.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:22.104 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:22.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:22.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:22.220+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:23.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:23.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:23.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:23.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:24.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:24.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:24.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:24.274+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:25.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:25.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:25.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:25.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:26.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:26.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:26.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:26.358+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:27.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:27.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:27.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:27.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:28.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:28.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:28.409 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:28.407+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:29.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:29.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:29.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:29.389+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:30.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:30.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:30.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:30.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:31.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:31.155+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:31.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:31.404+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:32.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:32.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:32.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:32.370+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:33.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:33.144+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:33.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:33.405+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:34.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:34.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:34.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:34.437+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:35.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:35.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:35.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:35.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:36.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:36.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:36.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:36.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:37.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:37.126+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:37.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:37.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:38.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:38.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:38.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:38.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:39.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:39.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:39.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:39.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:40.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:40.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:40.573 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:40.571+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:41.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:41.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:41.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:41.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:42.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:42.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:42.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:42.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:43.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:43.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:43.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:43.560+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:44.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:44.161+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:44.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:44.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:45.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:45.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:45.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:45.582+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:46.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:46.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:46.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:46.605+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:47.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:47.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:47.618 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:47.617+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:48.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:48.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:48.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:48.619+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:49.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:49.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:49.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:49.654+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:50.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:50.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:50.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:50.607+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:51.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:51.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:51.653 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:51.651+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:52.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:52.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:52.663 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:52.663+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:53.163 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:53.163+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:53.628 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:53.627+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:54.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:54.143+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:54.662 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:54.662+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:55.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:55.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:55.707 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:55.707+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:56.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:56.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:56.714 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:56.712+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:57.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:57.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:57.759 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:57.757+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:58.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:58.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:58.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:58.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:59.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:07:59.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:07:59.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:07:59.729+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:00.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:00.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:00.776 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:00.774+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:01.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:01.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:01.817 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:01.816+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:02.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:02.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:02.826 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:02.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:03.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:03.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:03.844 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:03.842+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:04.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:04.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:04.838 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:04.836+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:05.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:05.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:05.867 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:05.865+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:06.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:06.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:06.915 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:06.913+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:07.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:07.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:07.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:07.959+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:08.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:08.145+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:08.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:08.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:09.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:09.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:09.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:09.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:10.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:10.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:10.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:10.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:11.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:11.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:11.918 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:11.916+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:12.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:12.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:12.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:12.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:13.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:13.179+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:13.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:13.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:14.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:14.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:14.845 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:14.843+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:15.104 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:15.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:15.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:15.891+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:16.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:16.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:16.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:16.909+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:17.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:17.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:17.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:17.892+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:18.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:18.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:18.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:18.914+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:19.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:19.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:19.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:19.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:20.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:20.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:20.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:20.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:21.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:21.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:21.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:21.944+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:22.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:22.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:22.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:22.988+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:23.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:23.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:24.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:24.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:24.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:24.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:25.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:25.022+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:25.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:25.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:26.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:26.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:26.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:26.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:27.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:27.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:27.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:27.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:28.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:28.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:28.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:28.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:29.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:29.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:29.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:29.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:30.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:30.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:30.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:30.148+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:31.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:31.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:31.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:31.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:32.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:32.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:32.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:32.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:33.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:33.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:33.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:33.219+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:34.225 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:34.224+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:34.246 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:34.244+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:35.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:35.211+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:35.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:35.242+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:36.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:36.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:36.239 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:36.238+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:37.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:37.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:37.201 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:37.200+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:38.184 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:38.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:38.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:38.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:39.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:39.218+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:39.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:39.220+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:40.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:40.175+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:40.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:40.216+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:41.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:41.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:41.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:41.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:42.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:42.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:42.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:42.175+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:43.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:43.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:43.225 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:43.223+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:44.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:44.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:44.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:44.263+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:45.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:45.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:45.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:45.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:46.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:46.090+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:46.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:46.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:47.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:47.082+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:47.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:47.285+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:48.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:48.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:48.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:48.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:49.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:49.047+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:49.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:49.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:50.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:50.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:50.255 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:50.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:51.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:51.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:51.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:51.256+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:52.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:52.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:52.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:52.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:53.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:53.015+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:53.302 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:53.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:54.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:54.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:54.331 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:54.329+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:55.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:55.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:55.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:55.362+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:56.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:56.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:56.414 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:56.412+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:57.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:57.053+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:57.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:57.411+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:58.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:58.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:58.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:58.392+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:59.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:08:59.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:08:59.388 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:08:59.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:00.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:00.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:00.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:00.411+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:01.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:01.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:01.420 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:01.418+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:02.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:02.138+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:02.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:02.417+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:03.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:03.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:03.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:03.401+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:04.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:04.096+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:04.400 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:04.398+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:05.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:05.122+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:05.362 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:05.360+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:06.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:06.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:06.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:06.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:07.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:07.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:07.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:07.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:08.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:08.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:08.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:08.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:09.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:09.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:09.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:09.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:10.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:10.151+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:10.306 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:10.304+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:11.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:11.148+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:11.260 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:11.258+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:12.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:12.179+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:12.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:12.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:13.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:13.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:13.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:13.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:14.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:14.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:14.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:14.262+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:15.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:15.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:15.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:15.258+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:16.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:16.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:16.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:16.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:17.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:17.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:17.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:17.277+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:18.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:18.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:18.280 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:18.279+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:19.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:19.137+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:19.286 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:19.285+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:20.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:20.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:20.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:20.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:21.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:21.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:21.271 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:21.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:22.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:22.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:22.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:22.299+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:23.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:23.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:23.276 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:23.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:24.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:24.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:24.324 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:24.322+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:25.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:25.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:25.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:25.322+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:26.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:26.115+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:26.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:26.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:27.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:27.090+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:27.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:27.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:28.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:28.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:28.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:28.271+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:29.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:29.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:29.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:29.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:30.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:30.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:30.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:30.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:31.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:31.136+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:31.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:31.250+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:32.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:32.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:32.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:32.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:33.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:33.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:33.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:33.275+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:34.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:34.159+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:34.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:34.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:35.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:35.185+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:35.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:35.232+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:36.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:36.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:36.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:36.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:37.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:37.183+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:37.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:37.242+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:38.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:38.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:38.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:38.202+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:39.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:39.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:39.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:39.202+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:40.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:40.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:40.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:40.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:41.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:41.137+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:41.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:41.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:42.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:42.124+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:42.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:42.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:43.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:43.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:43.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:43.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:44.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:44.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:44.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:44.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:45.040 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:45.038+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:45.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:45.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:46.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:46.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:46.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:46.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:47.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:47.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:47.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:47.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:48.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:48.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:48.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:48.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:49.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:49.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:49.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:49.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:50.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:50.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:50.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:50.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:51.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:51.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:51.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:51.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:52.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:52.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:52.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:52.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:53.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:53.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:53.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:53.175+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:54.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:54.052+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:54.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:54.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:55.008 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:55.006+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:55.145 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:55.143+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:56.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:56.003+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:56.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:56.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:56.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:56.970+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:57.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:57.176+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:57.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:57.978+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:58.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:58.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:58.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:58.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:59.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:09:59.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:09:59.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:09:59.981+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:00.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:00.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:01.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:01.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:01.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:01.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:02.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:02.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:02.296 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:02.295+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:03.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:03.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:03.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:03.325+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:04.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:04.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:04.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:04.331+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:04.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:04.996+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:05.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:05.347+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:05.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:05.950+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:06.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:06.332+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:06.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:06.972+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:07.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:07.351+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:08.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:08.017+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:08.320 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:08.318+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:08.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:08.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:09.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:09.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:09.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:09.944+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:10.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:10.334+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:10.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:10.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:11.341 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:11.339+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:11.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:11.922+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:12.325 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:12.324+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:12.965 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:12.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:13.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:13.351+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:13.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:13.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:14.346 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:14.344+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:14.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:14.977+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:15.363 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:15.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:15.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:15.958+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:16.357 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:16.355+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:16.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:16.957+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:17.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:17.396+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:17.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:17.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:18.358 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:18.356+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:18.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:18.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:19.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:19.348+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:19.948 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:19.946+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:20.372 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:20.370+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:20.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:20.981+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:21.334 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:21.332+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:21.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:21.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:22.369 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:22.368+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:22.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:22.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:23.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:23.345+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:23.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:23.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:24.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:24.382+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:24.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:24.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:25.401 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:25.399+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:25.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:25.972+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:26.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:26.364+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:27.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:27.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:27.324 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:27.323+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:27.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:27.978+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:28.371 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:28.369+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:29.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:29.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:29.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:29.331+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:29.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:29.961+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:30.312 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:30.310+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:30.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:30.921+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:31.267 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:31.265+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:31.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:31.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:32.282 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:32.280+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:32.899 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:32.897+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:33.244 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:33.243+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:33.853 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:33.851+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:34.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:34.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:34.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:34.883+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:35.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:35.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:35.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:35.909+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:36.218 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:36.217+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:36.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:36.878+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:37.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:37.239+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:37.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:37.869+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:38.197 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:38.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:38.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:38.883+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:39.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:39.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:39.854 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:39.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:40.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:40.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:40.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:40.833+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:41.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:41.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:41.833 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:41.832+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:42.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:42.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:42.879 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:42.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:43.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:43.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:43.845 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:43.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:44.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:44.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:44.819 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:44.818+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:45.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:45.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:45.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:45.835+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:46.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:46.080+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:46.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:46.861+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:47.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:47.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:47.867 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:47.866+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:48.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:48.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:48.842 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:48.842+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:49.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:49.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:49.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:49.883+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:50.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:50.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:50.861 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:50.860+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:51.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:51.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:51.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:51.821+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:52.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:52.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:52.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:52.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:53.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:53.059+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:53.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:53.796+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:54.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:54.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:54.767 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:54.766+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:55.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:55.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:55.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:55.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:56.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:56.010+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:56.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:56.720+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:57.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:57.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:57.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:57.707+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:58.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:58.014+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:58.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:58.742+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:59.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:10:59.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:10:59.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:10:59.739+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:00.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:00.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:00.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:00.775+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:01.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:01.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:01.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:01.775+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:02.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:02.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:02.790 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:02.788+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:02.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:02.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:03.802 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:03.800+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:04.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:04.004+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:04.817 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:04.815+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:05.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:05.026+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:05.808 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:05.806+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:06.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:06.061+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:06.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:06.846+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:07.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:07.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:07.808 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:07.806+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:08.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:08.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:08.802 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:08.801+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:09.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:09.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:09.772 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:09.770+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:10.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:10.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:10.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:10.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:11.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:11.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:11.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:11.805+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:12.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:12.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:12.820 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:12.818+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:13.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:13.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:13.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:13.776+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:14.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:14.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:14.809 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:14.807+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:15.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:15.067+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:15.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:15.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:16.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:16.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:16.786 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:16.784+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:17.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:17.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:17.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:17.757+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:18.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:18.011+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:18.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:18.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:19.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:19.008+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:19.787 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:19.785+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:20.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:20.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:20.837 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:20.835+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:21.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:21.014+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:21.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:21.790+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:22.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:22.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:22.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:22.832+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:23.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:23.026+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:23.814 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:23.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:24.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:24.034+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:24.854 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:24.854+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:25.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:25.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:25.904 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:25.903+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:26.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:26.077+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:26.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:26.889+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:27.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:27.034+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:27.853 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:27.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:28.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:28.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:28.831 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:28.830+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:29.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:29.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:29.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:29.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:30.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:30.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:30.870 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:30.870+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:31.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:31.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:31.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:31.834+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:32.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:32.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:32.828 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:32.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:33.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:33.077+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:33.849 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:33.848+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:34.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:34.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:34.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:34.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:35.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:35.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:35.825 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:35.823+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:36.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:36.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:36.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:36.838+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:37.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:37.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:37.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:37.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:38.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:38.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:38.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:38.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:39.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:39.091+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:39.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:39.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:40.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:40.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:40.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:40.921+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:41.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:41.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:41.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:41.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:42.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:42.092+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:42.913 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:42.911+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:43.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:43.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:43.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:43.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:44.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:44.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:44.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:44.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:45.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:45.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:45.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:45.928+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:46.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:46.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:46.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:46.944+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:47.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:47.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:47.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:47.911+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:48.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:48.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:48.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:48.901+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:49.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:49.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:49.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:49.943+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:50.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:50.155+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:50.965 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:50.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:51.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:51.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:51.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:51.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:52.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:52.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:53.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:53.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:53.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:53.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:54.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:54.033+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:54.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:54.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:55.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:55.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:55.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:55.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:56.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:56.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:56.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:56.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:57.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:57.047+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:57.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:57.204+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:58.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:58.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:58.232 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:58.231+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:58.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:11:58.980+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:11:59.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:11:59.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:00.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:00.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:00.202 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:00.200+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:01.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:01.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:01.163 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:01.161+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:02.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:02.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:02.207 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:02.205+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:03.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:03.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:03.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:03.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:04.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:04.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:04.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:04.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:05.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:05.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:05.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:05.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:06.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:06.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:06.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:06.208+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:07.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:07.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:07.184 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:07.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:08.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:08.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:08.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:08.158+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:09.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:09.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:09.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:09.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:10.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:10.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:10.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:10.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:11.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:11.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:11.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:11.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:12.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:12.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:12.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:12.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:13.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:13.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:13.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:13.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:14.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:14.117+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:14.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:14.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:15.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:15.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:15.176 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:15.175+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:16.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:16.047+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:16.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:16.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:17.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:17.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:17.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:17.179+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:18.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:18.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:18.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:18.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:18.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:18.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:19.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:19.209+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:19.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:19.930+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:20.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:20.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:20.892 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:20.890+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:21.297 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:21.295+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:21.852 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:21.850+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:22.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:22.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:22.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:22.888+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:23.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:23.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:23.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:23.864+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:24.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:24.271+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:24.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:24.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:25.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:25.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:25.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:25.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:26.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:26.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:26.860 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:26.858+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:27.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:27.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:27.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:27.830+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:28.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:28.297+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:28.820 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:28.818+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:29.316 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:29.314+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:29.804 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:29.802+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:30.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:30.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:30.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:30.804+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:31.296 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:31.294+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:31.801 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:31.799+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:32.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:32.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:32.810 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:32.809+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:33.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:33.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:33.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:33.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:34.261 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:34.260+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:34.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:34.756+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:35.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:35.217+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:35.710 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:35.708+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:36.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:36.179+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:36.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:36.671+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:37.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:37.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:37.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:37.642+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:38.149 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:38.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:38.688 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:38.686+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:39.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:39.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:39.688 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:39.686+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:40.149 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:40.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:40.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:40.641+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:41.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:41.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:41.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:41.629+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:42.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:42.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:42.657 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:42.655+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:43.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:43.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:43.687 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:43.685+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:44.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:44.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:44.665 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:44.663+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:45.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:45.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:45.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:45.617+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:46.171 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:46.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:46.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:46.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:47.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:47.134+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:47.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:47.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:48.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:48.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:48.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:48.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:49.077 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:49.075+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:49.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:49.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:50.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:50.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:50.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:50.549+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:51.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:51.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:51.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:51.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:52.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:52.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:52.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:52.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:53.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:53.065+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:53.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:53.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:54.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:54.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:54.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:54.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:55.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:55.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:55.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:55.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:56.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:56.098+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:56.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:56.576+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:57.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:57.080+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:57.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:57.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:58.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:58.062+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:58.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:58.564+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:59.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:12:59.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:12:59.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:12:59.570+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:00.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:00.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:00.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:00.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:01.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:01.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:01.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:01.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:02.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:02.009+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:02.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:02.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:03.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:03.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:03.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:03.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:03.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:03.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:04.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:04.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:04.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:04.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:05.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:05.555+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:05.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:05.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:06.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:06.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:06.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:06.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:07.604 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:07.602+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:07.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:07.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:08.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:08.568+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:08.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:08.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:09.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:09.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:09.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:09.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:10.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:10.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:10.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:10.993+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:11.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:11.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:11.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:11.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:12.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:12.550+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:12.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:12.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:13.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:13.542+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:13.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:13.937+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:14.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:14.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:14.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:14.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:15.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:15.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:15.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:15.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:16.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:16.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:16.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:16.930+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:17.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:17.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:17.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:17.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:18.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:18.516+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:18.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:18.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:19.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:19.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:19.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:19.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:20.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:20.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:20.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:20.928+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:21.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:21.471+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:21.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:21.961+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:22.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:22.499+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:22.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:22.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:23.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:23.515+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:23.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:23.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:24.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:24.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:24.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:24.962+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:25.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:25.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:25.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:25.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:26.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:26.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:26.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:26.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:27.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:27.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:27.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:27.911+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:28.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:28.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:28.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:28.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:29.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:29.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:29.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:29.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:30.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:30.483+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:30.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:30.879+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:31.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:31.437+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:31.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:31.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:32.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:32.404+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:32.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:32.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:33.421 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:33.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:34.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:34.003+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:34.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:34.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:35.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:35.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:35.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:35.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:36.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:36.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:36.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:36.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:37.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:37.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:37.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:37.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:38.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:38.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:38.397 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:38.396+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:39.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:39.030+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:39.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:39.369+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:40.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:40.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:40.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:40.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:40.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:40.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:41.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:41.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:41.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:41.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:42.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:42.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:42.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:42.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:43.415 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:43.414+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:44.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:44.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:44.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:44.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:45.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:45.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:45.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:45.395+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:45.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:45.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:46.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:46.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:47.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:47.007+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:47.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:47.378+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:47.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:47.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:48.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:48.404+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:48.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:48.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:49.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:49.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:49.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:49.962+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:50.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:50.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:51.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:51.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:51.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:51.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:52.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:52.039+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:52.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:52.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:53.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:53.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:53.386 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:53.385+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:53.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:53.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:54.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:54.349+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:55.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:55.004+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:55.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:55.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:56.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:56.015+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:56.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:56.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:57.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:57.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:57.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:57.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:57.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:57.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:58.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:58.361+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:59.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:58.999+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:59.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:13:59.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:13:59.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:13:59.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:00.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:00.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:00.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:00.969+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:01.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:01.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:01.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:01.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:02.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:02.410+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:02.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:02.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:03.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:03.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:03.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:03.993+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:04.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:04.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:04.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:04.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:05.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:05.362+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:06.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:06.014+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:06.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:06.313+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:06.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:06.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:07.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:07.295+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:07.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:07.972+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:08.337 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:08.335+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:08.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:08.973+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:09.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:09.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:10.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:10.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:10.352 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:10.350+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:11.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:11.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:11.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:11.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:12.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:12.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:12.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:12.344+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:13.029 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:13.027+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:13.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:13.299+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:14.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:14.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:14.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:14.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:15.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:15.010+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:15.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:15.374+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:16.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:16.031+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:16.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:16.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:17.005 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:17.004+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:17.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:17.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:17.975 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:17.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:18.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:18.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:19.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:19.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:19.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:19.451+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:19.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:19.995+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:20.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:20.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:20.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:20.956+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:21.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:21.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:21.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:21.931+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:22.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:22.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:22.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:22.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:23.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:23.429+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:23.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:23.896+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:24.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:24.380+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:24.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:24.894+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:25.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:25.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:25.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:25.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:26.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:26.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:26.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:26.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:27.396 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:27.396+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:27.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:27.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:28.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:28.434+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:28.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:28.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:29.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:29.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:29.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:29.908+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:30.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:30.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:30.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:30.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:31.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:31.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:31.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:31.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:32.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:32.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:32.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:32.961+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:33.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:33.503+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:33.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:33.913+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:34.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:34.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:34.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:34.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:35.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:35.536+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:35.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:35.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:36.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:36.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:36.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:36.956+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:37.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:37.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:37.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:37.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:38.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:38.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:39.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:39.010+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:39.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:39.438+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:40.029 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:40.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:40.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:40.443+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:40.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:40.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:41.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:41.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:42.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:42.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:42.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:42.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:42.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:42.975+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:43.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:43.565+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:43.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:43.967+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:44.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:44.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:44.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:44.975+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:45.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:45.570+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:45.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:45.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:46.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:46.572+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:46.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:46.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:47.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:47.594+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:47.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:47.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:48.615 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:48.613+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:48.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:48.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:49.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:49.601+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:50.005 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:50.003+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:50.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:50.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:50.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:50.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:51.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:51.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:51.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:51.998+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:52.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:52.620+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:52.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:52.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:53.650 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:53.648+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:53.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:53.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:54.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:54.641+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:54.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:54.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:55.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:55.627+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:55.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:55.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:56.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:56.582+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:56.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:56.951+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:57.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:57.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:57.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:57.903+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:58.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:58.570+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:58.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:58.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:59.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:14:59.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:14:59.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:14:59.936+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:00.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:00.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:00.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:00.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:01.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:01.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:01.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:01.905+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:02.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:02.425+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:02.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:02.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:03.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:03.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:03.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:03.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:04.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:04.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:04.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:04.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:05.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:05.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:05.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:05.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:06.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:06.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:06.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:06.914+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:07.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:07.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:07.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:07.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:08.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:08.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:08.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:08.922+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:09.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:09.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:09.895 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:09.894+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:10.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:10.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:10.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:10.942+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:11.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:11.441+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:11.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:11.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:12.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:12.475+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:12.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:12.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:13.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:13.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:13.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:13.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:14.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:14.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:14.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:14.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:15.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:15.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:15.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:15.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:16.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:16.483+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:16.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:16.996+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:17.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:17.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:18.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:18.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:18.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:18.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:19.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:19.068+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:19.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:19.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:20.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:20.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:20.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:20.409+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:21.029 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:21.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:21.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:21.363+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:22.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:22.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:22.382 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:22.380+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:23.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:23.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:23.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:23.399+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:23.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:23.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:24.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:24.367+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:24.973 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:24.972+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:25.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:25.344+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:25.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:25.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:26.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:26.331+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:26.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:26.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:27.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:27.284+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:27.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:27.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:28.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:28.334+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:28.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:28.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:29.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:29.367+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:29.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:29.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:30.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:30.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:30.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:30.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:31.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:31.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:31.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:31.957+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:32.386 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:32.384+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:33.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:33.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:33.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:33.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:33.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:33.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:34.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:34.439+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:35.005 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:35.003+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:35.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:35.445+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:35.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:35.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:36.409 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:36.407+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:36.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:36.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:37.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:37.409+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:37.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:37.972+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:38.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:38.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:39.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:39.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:39.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:39.389+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:40.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:40.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:40.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:40.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:41.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:41.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:41.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:41.378+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:42.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:42.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:42.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:42.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:43.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:43.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:43.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:43.351+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:44.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:44.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:44.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:44.330+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:45.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:45.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:45.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:45.302+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:46.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:46.109+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:46.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:46.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:47.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:47.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:47.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:47.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:48.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:48.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:48.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:48.293+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:49.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:49.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:49.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:49.263+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:50.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:50.126+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:50.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:50.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:51.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:51.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:51.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:51.219+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:52.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:52.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:52.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:52.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:53.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:53.050+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:53.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:53.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:54.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:54.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:54.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:54.165+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:55.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:55.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:55.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:55.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:56.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:56.033+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:56.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:56.144+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:57.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:57.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:57.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:57.096+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:57.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:57.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:58.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:58.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:58.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:15:58.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:15:59.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:15:59.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:00.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:00.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:00.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:00.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:01.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:01.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:01.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:01.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:01.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:01.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:02.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:02.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:03.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:03.026+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:03.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:03.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:04.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:04.061+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:04.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:04.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:05.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:05.014+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:05.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:05.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:06.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:06.032+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:06.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:06.179+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:07.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:07.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:07.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:07.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:08.040 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:08.038+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:08.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:08.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:09.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:09.003+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:09.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:09.148+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:09.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:09.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:10.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:10.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:11.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:11.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:11.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:11.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:12.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:12.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:12.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:12.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:13.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:13.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:13.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:13.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:14.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:14.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:14.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:14.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:14.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:14.988+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:15.031 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:15.029+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:15.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:15.956+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:16.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:16.075+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:16.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:16.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:17.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:17.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:18.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:18.017+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:18.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:18.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:19.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:19.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:19.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:19.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:20.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:20.003+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:20.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:20.044+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:21.041 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:21.039+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:21.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:21.065+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:22.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:22.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:22.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:22.065+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:23.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:23.099+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:23.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:23.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:24.111 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:24.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:24.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:24.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:25.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:25.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:25.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:25.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:26.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:26.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:26.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:26.129+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:27.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:27.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:27.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:27.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:28.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:28.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:28.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:28.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:29.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:29.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:29.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:29.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:30.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:30.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:30.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:30.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:31.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:31.144+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:31.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:31.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:32.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:32.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:32.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:32.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:33.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:33.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:33.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:33.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:34.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:34.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:34.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:34.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:35.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:35.045+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:35.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:35.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:36.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:36.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:36.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:36.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:37.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:37.065+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:37.199 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:37.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:38.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:38.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:38.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:38.182+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:39.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:39.078+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:39.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:39.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:40.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:40.089+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:40.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:40.208+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:41.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:41.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:41.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:41.188+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:42.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:42.078+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:42.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:42.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:43.066 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:43.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:43.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:43.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:44.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:44.055+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:44.104 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:44.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:45.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:45.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:45.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:45.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:46.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:46.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:46.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:46.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:47.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:47.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:47.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:47.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:48.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:48.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:48.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:48.065+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:49.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:49.025+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:49.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:49.032+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:49.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:49.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:49.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:49.984+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:50.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:50.956+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:51.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:51.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:51.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:51.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:51.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:51.975+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:53.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:53.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:53.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:53.008+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:53.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:53.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:54.041 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:54.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:54.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:54.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:55.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:55.047+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:55.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:55.910+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:56.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:56.001+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:56.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:56.930+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:57.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:57.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:57.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:57.910+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:58.027 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:58.025+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:58.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:58.948+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:59.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:16:59.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:16:59.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:16:59.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:00.027 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:00.025+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:00.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:00.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:01.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:01.060+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:01.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:01.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:02.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:02.017+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:03.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:03.000+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:03.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:03.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:04.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:03.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:04.033 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:04.031+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:05.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:05.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:05.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:05.068+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:06.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:06.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:06.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:06.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:07.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:07.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:07.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:07.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:08.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:08.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:08.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:08.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:08.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:08.993+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:09.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:09.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:09.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:09.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:10.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:10.021+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:10.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:10.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:11.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:11.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:12.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:12.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:12.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:12.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:13.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:13.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:13.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:13.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:14.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:14.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:14.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:14.082+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:15.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:15.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:15.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:15.048+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:16.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:16.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:16.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:16.097+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:16.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:16.967+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:17.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:17.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:17.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:17.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:18.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:18.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:18.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:18.907+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:19.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:19.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:19.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:19.889+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:20.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:20.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:20.921 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:20.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:21.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:21.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:21.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:21.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:22.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:22.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:22.851 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:22.849+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:23.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:23.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:23.829 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:23.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:24.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:24.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:24.847 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:24.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:25.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:25.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:25.869 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:25.868+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:26.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:26.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:26.851 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:26.850+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:27.029 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:27.027+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:27.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:27.885+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:28.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:28.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:28.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:28.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:29.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:29.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:29.867 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:29.866+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:30.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:30.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:30.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:30.883+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:31.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:31.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:31.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:31.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:32.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:32.098+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:32.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:32.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:33.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:33.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:34.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:34.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:34.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:34.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:35.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:35.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:35.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:35.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:35.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:35.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:36.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:36.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:36.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:36.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:37.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:37.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:37.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:37.909+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:38.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:38.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:38.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:38.922+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:39.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:39.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:39.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:39.921+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:40.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:40.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:40.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:40.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:41.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:41.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:41.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:41.861+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:42.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:42.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:42.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:42.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:43.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:43.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:43.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:43.944+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:44.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:44.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:44.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:44.946+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:45.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:45.089+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:45.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:45.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:46.077 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:46.075+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:46.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:46.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:47.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:47.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:48.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:48.011+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:48.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:48.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:49.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:49.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:49.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:49.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:50.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:50.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:50.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:50.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:51.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:51.057+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:51.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:51.068+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:52.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:52.031+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:52.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:52.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:53.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:53.011+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:53.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:53.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:53.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:53.986+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:54.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:54.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:54.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:54.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:55.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:55.020+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:55.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:55.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:55.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:55.982+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:56.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:56.935+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:56.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:56.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:57.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:57.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:57.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:57.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:58.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:58.962+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:59.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:59.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:59.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:17:59.928+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:17:59.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:17:59.957+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:00.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:00.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:00.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:00.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:01.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:01.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:01.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:01.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:02.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:02.861+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:02.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:02.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:03.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:03.860+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:03.904 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:03.903+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:04.899 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:04.898+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:04.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:04.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:05.861 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:05.860+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:05.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:05.942+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:06.898 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:06.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:06.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:06.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:07.864 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:07.862+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:08.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:08.001+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:08.844 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:08.842+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:08.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:08.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:09.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:09.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:09.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:09.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:10.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:10.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:10.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:10.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:11.910 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:11.908+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:11.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:11.914+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:12.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:12.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:12.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:12.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:13.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:13.914+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:13.918 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:13.916+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:14.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:14.914+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:14.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:14.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:15.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:15.903+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:15.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:15.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:16.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:16.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:16.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:16.923+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:17.853 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:17.851+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:17.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:17.962+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:18.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:18.861+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:18.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:18.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:19.821 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:19.819+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:19.945 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:19.943+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:20.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:20.806+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:20.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:20.989+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:21.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:21.821+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:21.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:21.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:22.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:22.856+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:22.987 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:22.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:23.810 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:23.808+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:24.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:24.034+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:24.826 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:24.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:24.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:24.994+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:25.850 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:25.848+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:25.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:25.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:26.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:26.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:26.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:26.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:27.835 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:27.833+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:28.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:28.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:28.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:28.835+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:29.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:29.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:29.824 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:29.822+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:30.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:30.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:30.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:30.796+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:30.988 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:30.986+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:31.780 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:31.778+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:32.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:32.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:32.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:32.738+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:33.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:33.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:33.734 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:33.732+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:34.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:34.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:34.771 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:34.770+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:35.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:35.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:35.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:35.722+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:35.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:35.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:36.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:36.693+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:36.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:36.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:37.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:37.740+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:37.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:37.919+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:38.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:38.723+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:38.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:38.904+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:39.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:39.723+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:39.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:39.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:40.687 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:40.686+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:40.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:40.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:41.723 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:41.723+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:41.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:41.923+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:42.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:42.729+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:42.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:42.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:43.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:43.757+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:44.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:44.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:44.799 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:44.798+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:45.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:45.007+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:45.761 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:45.760+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:46.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:46.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:46.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:46.777+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:47.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:47.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:47.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:47.797+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:48.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:48.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:48.800 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:48.799+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:49.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:49.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:49.837 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:49.835+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:50.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:50.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:50.811 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:50.810+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:51.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:51.209+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:51.826 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:51.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:52.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:52.188+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:52.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:52.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:53.229 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:53.228+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:53.873 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:53.872+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:54.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:54.208+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:54.842 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:54.841+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:55.215 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:55.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:55.804 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:55.802+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:56.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:56.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:56.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:56.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:57.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:57.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:57.738 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:57.735+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:58.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:58.260+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:58.736 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:58.734+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:59.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:18:59.217+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:18:59.764 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:18:59.762+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:00.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:00.184+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:00.808 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:00.806+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:01.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:01.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:01.843 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:01.841+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:02.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:02.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:02.852 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:02.850+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:03.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:03.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:03.845 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:03.842+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:04.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:04.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:04.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:04.835+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:05.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:05.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:05.868 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:05.866+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:06.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:06.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:06.892 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:06.891+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:07.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:07.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:07.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:07.888+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:08.032 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:08.030+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:08.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:08.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:09.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:09.011+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:09.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:09.971+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:10.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:10.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:10.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:10.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:11.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:11.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:11.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:11.961+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:12.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:12.121+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:12.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:12.991+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:13.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:13.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:14.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:14.025+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:14.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:14.202+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:15.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:15.060+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:15.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:15.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:16.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:16.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:16.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:16.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:17.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:17.062+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:17.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:17.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:18.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:18.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:18.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:18.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:19.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:19.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:19.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:19.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:20.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:20.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:20.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:20.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:21.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:21.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:21.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:21.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:22.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:22.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:22.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:22.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:23.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:23.095+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:23.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:23.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:24.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:24.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:24.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:24.158+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:25.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:25.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:25.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:25.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:26.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:26.089+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:26.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:26.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:27.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:27.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:27.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:27.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:28.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:28.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:28.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:28.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:29.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:29.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:29.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:29.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:30.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:30.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:30.175 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:30.174+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:31.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:31.119+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:31.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:31.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:32.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:32.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:32.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:32.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:33.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:33.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:33.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:33.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:34.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:34.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:34.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:34.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:35.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:35.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:35.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:35.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:36.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:36.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:36.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:36.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:37.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:37.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:37.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:37.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:38.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:38.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:38.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:38.163+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:39.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:39.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:39.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:39.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:40.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:40.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:40.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:40.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:41.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:41.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:41.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:41.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:42.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:42.100+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:42.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:42.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:43.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:43.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:43.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:43.145+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:44.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:44.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:44.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:44.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:45.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:45.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:45.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:45.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:46.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:46.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:46.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:46.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:47.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:47.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:47.207 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:47.205+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:48.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:48.125+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:48.203 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:48.201+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:49.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:49.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:49.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:49.229+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:50.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:50.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:50.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:50.232+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:51.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:51.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:51.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:51.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:52.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:52.168+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:52.238 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:52.236+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:53.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:53.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:53.224 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:53.222+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:54.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:54.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:54.251 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:54.249+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:55.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:55.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:55.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:55.217+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:56.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:56.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:56.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:56.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:57.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:57.079+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:57.239 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:57.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:58.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:58.078+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:58.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:58.229+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:59.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:19:59.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:19:59.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:19:59.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:00.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:00.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:00.215 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:00.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:01.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:01.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:01.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:01.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:02.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:02.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:02.267 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:02.265+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:03.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:03.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:03.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:03.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:04.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:04.090+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:04.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:04.199+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:05.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:05.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:05.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:05.211+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:06.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:06.100+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:06.199 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:06.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:07.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:07.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:07.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:07.161+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:08.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:08.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:08.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:08.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:09.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:09.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:09.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:09.189+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:10.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:10.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:10.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:10.159+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:11.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:11.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:11.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:11.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:12.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:12.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:12.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:12.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:13.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:13.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:13.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:13.226+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:14.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:14.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:14.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:14.232+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:15.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:15.092+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:15.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:15.185+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:16.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:16.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:16.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:16.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:17.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:17.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:17.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:17.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:18.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:18.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:18.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:18.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:19.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:19.115+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:19.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:19.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:20.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:20.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:20.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:20.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:21.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:21.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:21.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:21.201+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:22.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:22.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:22.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:22.220+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:23.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:23.126+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:23.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:23.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:24.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:24.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:24.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:24.214+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:25.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:25.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:25.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:25.182+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:26.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:26.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:26.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:26.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:27.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:27.134+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:27.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:27.163+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:28.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:28.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:28.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:28.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:29.149 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:29.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:29.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:29.192+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:30.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:30.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:30.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:30.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:31.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:31.159+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:31.197 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:31.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:32.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:32.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:32.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:32.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:33.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:33.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:33.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:33.199+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:34.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:34.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:34.242 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:34.240+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:35.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:35.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:35.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:35.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:36.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:36.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:36.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:36.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:37.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:37.167+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:37.176 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:37.175+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:38.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:38.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:38.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:38.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:39.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:39.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:39.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:39.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:40.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:40.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:40.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:40.195+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:41.184 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:41.182+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:41.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:41.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:42.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:42.192+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:42.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:42.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:43.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:43.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:43.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:43.216+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:44.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:44.206+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:44.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:44.216+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:45.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:45.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:45.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:45.256+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:46.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:46.225+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:46.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:46.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:47.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:47.215+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:47.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:47.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:48.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:48.190+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:48.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:48.274+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:49.149 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:49.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:49.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:49.233+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:50.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:50.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:50.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:50.263+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:51.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:51.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:51.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:51.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:52.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:52.190+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:52.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:52.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:53.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:53.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:53.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:53.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:54.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:54.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:54.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:54.380+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:55.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:55.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:55.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:55.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:56.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:56.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:56.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:56.411+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:57.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:57.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:57.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:57.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:58.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:58.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:58.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:58.399+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:59.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:20:59.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:20:59.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:20:59.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:00.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:00.155+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:00.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:00.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:01.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:01.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:01.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:01.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:02.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:02.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:02.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:02.354+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:03.179 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:03.177+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:03.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:03.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:04.218 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:04.216+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:04.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:04.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:05.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:05.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:05.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:05.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:06.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:06.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:06.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:06.342+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:07.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:07.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:07.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:07.295+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:08.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:08.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:08.337 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:08.335+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:09.205 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:09.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:09.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:09.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:10.253 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:10.251+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:10.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:10.289+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:11.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:11.257+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:11.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:11.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:12.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:12.220+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:12.296 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:12.294+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:13.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:13.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:13.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:13.263+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:14.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:14.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:14.297 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:14.295+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:15.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:15.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:15.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:15.331+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:16.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:16.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:16.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:16.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:17.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:17.204+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:17.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:17.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:18.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:18.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:18.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:18.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:19.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:19.246+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:19.313 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:19.311+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:20.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:20.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:20.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:20.332+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:21.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:21.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:21.328 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:21.326+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:22.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:22.260+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:22.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:22.376+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:23.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:23.258+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:23.387 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:23.385+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:24.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:24.219+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:24.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:24.409+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:25.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:25.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:25.418 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:25.416+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:26.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:26.261+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:26.381 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:26.379+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:27.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:27.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:27.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:27.351+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:28.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:28.256+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:28.309 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:28.307+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:29.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:29.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:29.344 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:29.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:30.286 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:30.284+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:30.373 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:30.371+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:31.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:31.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:31.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:31.364+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:32.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:32.301+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:32.383 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:32.383+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:33.330 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:33.329+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:33.374 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:33.373+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:34.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:34.352+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:34.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:34.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:35.362 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:35.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:35.396 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:35.395+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:36.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:36.335+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:36.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:36.369+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:37.319 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:37.319+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:37.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:37.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:38.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:38.288+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:38.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:38.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:39.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:39.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:39.415 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:39.414+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:40.335 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:40.335+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:40.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:40.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:41.309 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:41.308+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:41.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:41.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:42.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:42.353+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:42.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:42.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:43.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:43.328+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:43.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:43.392+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:44.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:44.288+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:44.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:44.403+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:45.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:45.290+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:45.422 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:45.421+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:46.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:46.289+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:46.466 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:46.464+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:47.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:47.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:47.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:47.477+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:48.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:48.276+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:48.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:48.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:49.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:49.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:49.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:49.497+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:50.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:50.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:50.520 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:50.518+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:51.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:51.218+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:51.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:51.483+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:52.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:52.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:52.495 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:52.493+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:53.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:53.248+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:53.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:53.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:54.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:54.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:54.513 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:54.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:55.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:55.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:55.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:55.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:56.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:56.259+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:56.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:56.520+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:57.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:57.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:57.500 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:57.498+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:58.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:58.277+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:58.498 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:58.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:59.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:21:59.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:21:59.484 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:21:59.483+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:00.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:00.325+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:00.486 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:00.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:01.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:01.336+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:01.450 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:01.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:02.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:02.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:02.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:02.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:03.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:03.422+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:03.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:03.530+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:04.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:04.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:04.501 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:04.499+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:05.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:05.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:05.483 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:05.481+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:06.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:06.462+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:06.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:06.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:07.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:07.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:07.507 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:07.505+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:08.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:08.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:08.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:08.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:09.514 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:09.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:09.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:09.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:10.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:10.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:10.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:10.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:11.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:11.509+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:11.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:11.553+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:12.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:12.554+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:12.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:12.593+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:13.598 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:13.596+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:13.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:13.598+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:14.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:14.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:14.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:14.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:15.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:15.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:15.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:15.628+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:16.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:16.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:16.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:16.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:17.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:17.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:17.619 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:17.618+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:18.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:18.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:18.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:18.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:19.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:19.451+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:19.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:19.649+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:20.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:20.451+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:20.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:20.659+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:21.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:21.416+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:21.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:21.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:22.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:22.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:22.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:22.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:23.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:23.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:23.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:23.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:24.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:24.404+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:24.645 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:24.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:25.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:25.445+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:25.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:25.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:26.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:26.425+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:26.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:26.590+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:27.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:27.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:27.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:27.631+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:28.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:28.425+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:28.621 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:28.619+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:29.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:29.415+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:29.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:29.593+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:30.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:30.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:30.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:30.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:31.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:31.421+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:31.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:31.585+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:32.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:32.471+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:32.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:32.586+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:33.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:33.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:33.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:33.571+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:34.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:34.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:34.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:34.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:35.508 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:35.507+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:35.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:35.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:36.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:36.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:36.558 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:36.556+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:37.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:37.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:37.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:37.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:38.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:38.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:38.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:38.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:39.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:39.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:39.525 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:39.523+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:40.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:40.502+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:40.520 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:40.518+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:41.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:41.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:41.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:41.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:42.464 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:42.462+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:42.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:42.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:43.479 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:43.477+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:43.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:43.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:44.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:44.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:44.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:44.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:45.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:45.468+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:45.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:45.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:46.476 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:46.474+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:46.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:46.509+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:47.504 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:47.503+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:47.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:47.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:48.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:48.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:48.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:48.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:49.489 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:49.487+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:49.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:49.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:50.449 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:50.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:50.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:50.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:51.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:51.459+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:51.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:51.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:52.442 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:52.440+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:52.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:52.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:53.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:53.394+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:53.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:53.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:54.354 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:54.352+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:54.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:54.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:55.344 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:55.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:55.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:55.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:56.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:56.374+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:56.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:56.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:57.379 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:57.377+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:57.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:57.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:58.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:58.335+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:58.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:58.476+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:59.334 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:22:59.333+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:22:59.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:22:59.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:00.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:00.322+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:00.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:00.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:01.297 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:01.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:01.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:01.422+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:02.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:02.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:02.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:02.438+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:03.322 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:03.321+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:03.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:03.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:04.304 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:04.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:04.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:04.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:05.329 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:05.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:05.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:05.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:06.329 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:06.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:06.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:06.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:07.304 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:07.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:07.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:07.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:08.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:08.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:08.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:08.500+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:09.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:09.360+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:09.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:09.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:10.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:10.314+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:10.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:10.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:11.295 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:11.293+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:11.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:11.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:12.282 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:12.280+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:12.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:12.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:13.240 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:13.238+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:13.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:13.471+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:14.255 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:14.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:14.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:14.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:15.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:15.224+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:15.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:15.455+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:16.199 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:16.197+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:16.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:16.431+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:17.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:17.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:17.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:17.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:18.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:18.211+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:18.435 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:18.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:19.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:19.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:19.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:19.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:20.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:20.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:20.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:20.365+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:21.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:21.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:21.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:21.369+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:22.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:22.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:22.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:22.388+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:23.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:23.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:23.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:23.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:24.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:24.039+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:24.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:24.441+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:25.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:25.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:25.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:25.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:26.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:26.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:26.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:26.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:27.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:27.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:27.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:27.451+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:28.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:28.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:28.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:28.473+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:29.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:29.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:29.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:29.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:30.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:30.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:30.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:30.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:31.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:31.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:31.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:31.516+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:32.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:32.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:32.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:32.483+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:33.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:33.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:33.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:33.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:34.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:34.131+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:34.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:34.487+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:35.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:35.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:35.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:35.502+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:36.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:36.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:36.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:36.538+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:37.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:37.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:37.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:37.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:38.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:38.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:38.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:38.572+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:39.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:39.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:39.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:39.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:40.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:40.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:40.670 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:40.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:41.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:41.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:41.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:41.658+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:42.176 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:42.174+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:42.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:42.637+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:43.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:43.158+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:43.630 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:43.629+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:44.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:44.177+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:44.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:44.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:45.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:45.211+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:45.597 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:45.596+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:46.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:46.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:46.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:46.555+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:47.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:47.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:47.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:47.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:48.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:48.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:48.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:48.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:49.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:49.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:49.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:49.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:50.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:50.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:50.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:50.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:51.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:51.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:51.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:51.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:52.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:52.265+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:52.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:52.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:53.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:53.219+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:53.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:53.584+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:54.205 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:54.204+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:54.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:54.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:55.233 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:55.232+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:55.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:55.556+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:56.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:56.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:56.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:56.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:57.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:57.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:57.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:57.564+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:58.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:58.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:58.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:58.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:59.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:23:59.225+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:23:59.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:23:59.509+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:00.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:00.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:00.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:00.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:01.286 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:01.285+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:01.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:01.475+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:02.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:02.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:02.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:02.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:03.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:03.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:03.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:03.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:04.313 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:04.311+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:04.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:04.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:05.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:05.334+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:05.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:05.453+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:06.328 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:06.326+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:06.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:06.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:07.295 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:07.293+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:07.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:07.483+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:08.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:08.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:08.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:08.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:09.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:09.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:09.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:09.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:10.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:10.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:10.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:10.451+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:11.291 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:11.289+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:11.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:11.455+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:12.339 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:12.337+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:12.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:12.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:13.368 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:13.366+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:13.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:13.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:14.409 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:14.407+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:14.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:14.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:15.402 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:15.400+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:15.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:15.500+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:16.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:16.365+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:16.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:16.455+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:17.370 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:17.368+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:17.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:17.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:18.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:18.392+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:18.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:18.443+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:19.352 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:19.351+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:19.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:19.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:20.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:20.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:20.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:20.487+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:21.344 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:21.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:21.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:21.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:22.380 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:22.378+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:22.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:22.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:23.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:23.365+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:23.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:23.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:24.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:24.338+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:24.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:24.508+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:25.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:25.348+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:25.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:25.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:26.312 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:26.311+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:26.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:26.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:27.267 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:27.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:27.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:27.405+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:28.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:28.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:28.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:28.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:29.304 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:29.302+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:29.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:29.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:30.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:30.310+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:30.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:30.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:31.280 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:31.279+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:31.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:31.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:32.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:32.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:32.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:32.438+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:33.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:33.271+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:33.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:33.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:34.253 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:34.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:34.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:34.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:35.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:35.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:35.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:35.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:36.240 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:36.239+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:36.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:36.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:37.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:37.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:37.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:37.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:38.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:38.209+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:38.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:38.410+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:39.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:39.241+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:39.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:39.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:40.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:40.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:40.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:40.348+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:41.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:41.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:41.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:41.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:42.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:42.254+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:42.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:42.334+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:43.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:43.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:43.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:43.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:44.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:44.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:44.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:44.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:45.341 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:45.339+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:45.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:45.356+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:46.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:46.325+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:46.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:46.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:47.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:47.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:47.371 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:47.370+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:48.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:48.333+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:48.352 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:48.351+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:49.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:49.295+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:49.374 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:49.372+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:50.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:50.287+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:50.373 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:50.372+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:51.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:51.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:51.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:51.382+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:52.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:52.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:52.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:52.353+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:53.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:53.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:53.355 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:53.354+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:54.337 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:54.335+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:54.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:54.338+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:55.292 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:55.290+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:55.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:55.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:56.281 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:56.279+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:56.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:56.336+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:57.330 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:57.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:57.379 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:57.377+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:58.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:58.330+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:58.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:58.362+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:59.326 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:24:59.324+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:24:59.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:24:59.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:00.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:00.362+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:00.415 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:00.414+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:01.339 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:01.337+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:01.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:01.441+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:02.367 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:02.366+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:02.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:02.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:03.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:03.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:03.407 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:03.405+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:04.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:04.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:04.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:04.396+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:05.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:05.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:05.430 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:05.428+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:06.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:06.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:06.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:06.468+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:07.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:07.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:07.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:07.491+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:08.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:08.494+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:08.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:08.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:09.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:09.499+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:09.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:09.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:10.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:10.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:10.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:10.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:11.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:11.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:11.559 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:11.558+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:12.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:12.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:12.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:12.606+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:13.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:13.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:13.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:13.565+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:14.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:14.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:14.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:14.602+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:15.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:15.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:15.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:15.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:16.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:16.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:16.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:16.591+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:17.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:17.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:17.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:17.635+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:18.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:18.500+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:18.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:18.640+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:19.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:19.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:19.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:19.590+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:20.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:20.546+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:20.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:20.633+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:21.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:21.563+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:21.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:21.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:22.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:22.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:22.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:22.670+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:23.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:23.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:23.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:23.675+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:24.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:24.564+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:24.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:24.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:25.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:25.591+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:25.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:25.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:26.639 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:26.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:26.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:26.669+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:27.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:27.600+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:27.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:27.703+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:28.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:28.590+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:28.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:28.666+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:29.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:29.640+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:29.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:29.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:30.657 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:30.655+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:30.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:30.658+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:31.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:31.620+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:31.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:31.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:32.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:32.582+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:32.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:32.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:33.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:33.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:33.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:33.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:34.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:34.563+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:34.593 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:34.591+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:35.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:35.555+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:35.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:35.611+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:36.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:36.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:36.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:36.632+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:37.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:37.572+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:37.617 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:37.615+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:38.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:38.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:38.616 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:38.615+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:39.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:39.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:39.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:39.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:40.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:40.580+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:40.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:40.611+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:41.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:41.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:41.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:41.587+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:42.554 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:42.553+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:42.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:42.600+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:43.519 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:43.517+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:43.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:43.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:44.520 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:44.519+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:44.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:44.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:45.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:45.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:45.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:45.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:46.521 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:46.519+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:46.627 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:46.625+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:47.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:47.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:47.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:47.589+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:48.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:48.517+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:48.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:48.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:49.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:49.530+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:49.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:49.574+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:50.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:50.527+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:50.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:50.591+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:51.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:51.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:51.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:51.549+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:52.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:52.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:52.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:52.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:53.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:53.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:53.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:53.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:54.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:54.542+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:54.614 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:54.613+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:55.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:55.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:55.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:55.655+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:56.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:56.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:56.701 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:56.700+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:57.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:57.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:57.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:57.680+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:58.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:58.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:58.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:58.729+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:59.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:25:59.483+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:25:59.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:25:59.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:00.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:00.445+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:00.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:00.758+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:01.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:01.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:01.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:01.766+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:02.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:02.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:02.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:02.763+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:03.409 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:03.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:03.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:03.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:04.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:04.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:04.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:04.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:05.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:05.409+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:05.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:05.728+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:06.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:06.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:06.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:06.758+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:07.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:07.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:07.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:07.802+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:08.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:08.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:08.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:08.762+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:09.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:09.314+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:09.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:09.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:10.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:10.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:10.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:10.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:11.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:11.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:11.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:11.780+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:12.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:12.334+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:12.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:12.789+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:13.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:13.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:13.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:13.780+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:14.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:14.374+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:14.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:14.762+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:15.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:15.351+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:15.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:15.812+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:16.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:16.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:16.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:16.806+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:17.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:17.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:17.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:17.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:18.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:18.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:18.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:18.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:19.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:19.326+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:19.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:19.714+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:20.291 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:20.289+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:20.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:20.683+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:21.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:21.307+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:21.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:21.651+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:22.321 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:22.319+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:22.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:22.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:23.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:23.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:23.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:23.611+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:24.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:24.287+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:24.604 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:24.602+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:25.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:25.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:25.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:25.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:26.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:26.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:26.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:26.535+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:27.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:27.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:27.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:27.572+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:28.421 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:28.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:28.593 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:28.591+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:29.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:29.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:29.576 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:29.574+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:30.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:30.425+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:30.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:30.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:31.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:31.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:31.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:31.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:32.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:32.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:32.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:32.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:33.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:33.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:33.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:33.562+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:34.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:34.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:34.573 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:34.568+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:35.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:35.502+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:35.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:35.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:36.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:36.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:36.512 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:36.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:37.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:37.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:37.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:37.560+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:38.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:38.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:38.576 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:38.575+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:39.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:39.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:39.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:39.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:40.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:40.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:40.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:40.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:41.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:41.498+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:41.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:41.590+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:42.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:42.462+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:42.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:42.566+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:43.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:43.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:43.608 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:43.607+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:44.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:44.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:44.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:44.648+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:45.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:45.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:45.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:45.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:46.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:46.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:46.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:46.661+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:47.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:47.431+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:47.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:47.638+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:48.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:48.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:48.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:48.640+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:49.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:49.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:49.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:49.668+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:50.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:50.447+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:50.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:50.665+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:51.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:51.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:51.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:51.637+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:52.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:52.365+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:52.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:52.591+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:53.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:53.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:53.544 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:53.542+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:54.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:54.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:54.514 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:54.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:55.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:55.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:55.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:55.493+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:56.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:56.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:56.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:56.520+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:57.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:57.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:57.476 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:57.475+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:58.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:58.405+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:58.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:58.515+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:59.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:26:59.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:26:59.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:26:59.528+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:00.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:00.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:00.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:00.571+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:01.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:01.413+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:01.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:01.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:02.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:02.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:02.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:02.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:03.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:03.494+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:03.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:03.509+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:04.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:04.459+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:04.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:04.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:05.486 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:05.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:05.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:05.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:06.455 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:06.453+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:06.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:06.548+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:07.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:07.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:07.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:07.502+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:08.465 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:08.463+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:08.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:08.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:09.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:09.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:09.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:09.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:10.451 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:10.449+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:10.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:10.542+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:11.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:11.426+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:11.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:11.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:12.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:12.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:12.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:12.581+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:13.520 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:13.519+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:13.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:13.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:14.526 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:14.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:14.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:14.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:15.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:15.487+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:15.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:15.501+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:16.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:16.494+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:16.521 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:16.519+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:17.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:17.484+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:17.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:17.498+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:18.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:18.462+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:18.545 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:18.544+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:19.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:19.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:19.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:19.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:20.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:20.546+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:20.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:20.581+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:21.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:21.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:21.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:21.624+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:22.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:22.516+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:22.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:22.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:23.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:23.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:23.597 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:23.596+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:24.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:24.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:24.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:24.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:25.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:25.461+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:25.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:25.585+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:26.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:26.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:26.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:26.561+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:27.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:27.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:27.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:27.530+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:28.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:28.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:28.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:28.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:29.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:29.438+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:29.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:29.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:30.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:30.399+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:30.514 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:30.513+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:31.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:31.422+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:31.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:31.560+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:32.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:32.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:32.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:32.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:33.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:33.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:33.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:33.547+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:34.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:34.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:34.535 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:34.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:35.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:35.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:35.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:35.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:36.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:36.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:36.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:36.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:37.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:37.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:37.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:37.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:38.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:38.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:38.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:38.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:39.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:39.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:39.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:39.600+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:40.547 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:40.545+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:40.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:40.605+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:41.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:41.572+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:41.635 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:41.633+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:42.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:42.561+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:42.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:42.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:43.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:43.560+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:43.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:43.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:44.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:44.563+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:44.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:44.565+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:45.546 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:45.544+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:45.610 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:45.609+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:46.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:46.555+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:46.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:46.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:47.588 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:47.586+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:47.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:47.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:48.600 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:48.598+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:48.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:48.619+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:49.605 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:49.603+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:49.663 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:49.661+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:50.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:50.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:50.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:50.641+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:51.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:51.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:51.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:51.611+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:52.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:52.566+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:52.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:52.581+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:53.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:53.538+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:53.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:53.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:54.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:54.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:54.558 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:54.556+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:55.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:55.549+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:55.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:55.561+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:56.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:56.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:56.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:56.568+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:57.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:57.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:57.597 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:57.595+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:58.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:58.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:58.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:58.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:59.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:27:59.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:27:59.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:27:59.670+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:00.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:00.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:00.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:00.652+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:01.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:01.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:01.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:01.609+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:02.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:02.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:02.658 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:02.656+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:03.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:03.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:03.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:03.628+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:04.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:04.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:04.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:04.652+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:05.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:05.585+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:05.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:05.694+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:06.622 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:06.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:06.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:06.714+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:07.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:07.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:07.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:07.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:08.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:08.601+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:08.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:08.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:09.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:09.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:09.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:09.659+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:10.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:10.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:10.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:10.706+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:11.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:11.563+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:11.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:11.708+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:12.612 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:12.612+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:12.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:12.738+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:13.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:13.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:13.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:13.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:14.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:14.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:14.707 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:14.707+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:15.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:15.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:15.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:15.748+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:16.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:16.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:16.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:16.771+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:17.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:17.508+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:17.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:17.725+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:18.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:18.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:18.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:18.721+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:19.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:19.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:19.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:19.745+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:20.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:20.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:20.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:20.719+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:21.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:21.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:21.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:21.749+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:22.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:22.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:22.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:22.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:23.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:23.560+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:23.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:23.691+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:24.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:24.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:24.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:24.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:25.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:25.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:25.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:25.670+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:26.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:26.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:26.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:26.719+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:27.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:27.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:27.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:27.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:28.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:28.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:28.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:28.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:29.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:29.499+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:29.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:29.671+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:30.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:30.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:30.645 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:30.641+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:31.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:31.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:31.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:31.659+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:32.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:32.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:32.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:32.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:33.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:33.498+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:33.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:33.724+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:34.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:34.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:34.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:34.698+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:35.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:35.502+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:35.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:35.658+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:36.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:36.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:36.707 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:36.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:37.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:37.448+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:37.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:37.696+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:38.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:38.487+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:38.730 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:38.728+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:39.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:39.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:39.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:39.710+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:40.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:40.484+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:40.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:40.668+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:41.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:41.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:41.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:41.621+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:42.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:42.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:42.604 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:42.597+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:43.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:43.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:43.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:43.587+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:44.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:44.556+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:44.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:44.623+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:45.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:45.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:45.652 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:45.650+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:46.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:46.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:46.607 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:46.605+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:47.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:47.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:47.593 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:47.593+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:48.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:48.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:48.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:48.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:49.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:49.575+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:49.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:49.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:50.539 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:50.538+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:50.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:50.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:51.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:51.491+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:51.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:51.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:52.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:52.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:52.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:52.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:53.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:53.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:53.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:53.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:54.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:54.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:54.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:54.517+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:55.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:55.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:55.521 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:55.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:56.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:56.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:56.516 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:56.515+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:57.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:57.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:57.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:57.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:58.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:58.435+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:58.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:58.559+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:59.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:28:59.437+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:28:59.536 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:28:59.534+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:00.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:00.421+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:00.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:00.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:01.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:01.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:01.490 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:01.489+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:02.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:02.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:02.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:02.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:03.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:03.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:03.471 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:03.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:04.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:04.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:04.484 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:04.482+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:05.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:05.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:05.448 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:05.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:06.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:06.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:06.450 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:06.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:07.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:07.437+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:07.454 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:07.453+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:08.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:08.429+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:08.435 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:08.433+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:09.451 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:09.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:09.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:09.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:10.445 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:10.443+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:10.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:10.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:11.401 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:11.400+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:11.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:11.548+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:12.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:12.417+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:12.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:12.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:13.441 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:13.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:13.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:13.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:14.392 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:14.390+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:14.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:14.509+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:15.441 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:15.440+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:15.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:15.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:16.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:16.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:16.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:16.499+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:17.466 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:17.464+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:17.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:17.494+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:18.425 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:18.423+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:18.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:18.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:19.447 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:19.445+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:19.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:19.498+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:20.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:20.470+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:20.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:20.515+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:21.449 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:21.447+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:21.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:21.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:22.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:22.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:22.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:22.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:23.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:23.441+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:23.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:23.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:24.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:24.401+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:24.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:24.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:25.445 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:25.443+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:25.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:25.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:26.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:26.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:26.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:26.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:27.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:27.441+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:27.528 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:27.527+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:28.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:28.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:28.487 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:28.486+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:29.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:29.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:29.467 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:29.465+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:30.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:30.399+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:30.498 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:30.498+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:31.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:31.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:31.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:31.497+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:32.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:32.384+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:32.525 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:32.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:33.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:33.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:33.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:33.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:34.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:34.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:34.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:34.566+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:35.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:35.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:35.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:35.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:36.421 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:36.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:36.539 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:36.539+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:37.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:37.455+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:37.523 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:37.522+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:38.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:38.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:38.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:38.564+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:39.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:39.429+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:39.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:39.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:40.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:40.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:40.509 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:40.509+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:41.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:41.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:41.560 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:41.557+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:42.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:42.370+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:42.513 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:42.511+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:43.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:43.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:43.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:43.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:44.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:44.379+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:44.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:44.476+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:45.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:45.334+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:45.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:45.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:46.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:46.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:46.498 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:46.495+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:47.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:47.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:47.483 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:47.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:48.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:48.399+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:48.500 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:48.498+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:49.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:49.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:49.507 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:49.506+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:50.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:50.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:50.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:50.461+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:51.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:51.421+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:51.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:51.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:52.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:52.459+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:52.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:52.515+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:53.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:53.494+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:53.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:53.508+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:54.531 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:54.530+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:54.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:54.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:55.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:55.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:55.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:55.556+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:56.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:56.538+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:56.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:56.582+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:57.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:57.555+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:57.559 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:57.558+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:58.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:58.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:58.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:58.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:59.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:29:59.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:29:59.594 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:29:59.592+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:00.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:00.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:00.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:00.642+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:01.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:01.565+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:01.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:01.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:02.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:02.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:02.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:02.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:03.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:03.560+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:03.688 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:03.687+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:04.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:04.606+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:04.651 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:04.650+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:05.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:05.644+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:05.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:05.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:06.662 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:06.660+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:06.699 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:06.697+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:07.663 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:07.662+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:07.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:07.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:08.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:08.632+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:08.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:08.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:09.622 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:09.620+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:09.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:09.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:10.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:10.607+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:10.615 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:10.613+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:11.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:11.594+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:11.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:11.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:12.641 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:12.639+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:12.650 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:12.648+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:13.610 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:13.608+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:13.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:13.675+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:14.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:14.594+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:14.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:14.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:15.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:15.570+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:15.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:15.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:16.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:16.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:16.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:16.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:17.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:17.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:17.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:17.723+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:18.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:18.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:18.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:18.746+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:19.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:19.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:19.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:19.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:20.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:20.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:20.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:20.733+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:21.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:21.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:21.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:21.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:22.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:22.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:22.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:22.694+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:23.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:23.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:23.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:23.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:24.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:24.441+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:24.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:24.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:25.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:25.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:25.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:25.786+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:26.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:26.475+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:26.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:26.739+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:27.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:27.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:27.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:27.747+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:28.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:28.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:28.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:28.774+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:29.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:29.498+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:29.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:29.748+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:30.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:30.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:30.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:30.794+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:31.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:31.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:31.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:31.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:32.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:32.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:32.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:32.776+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:33.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:33.502+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:33.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:33.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:34.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:34.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:34.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:34.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:35.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:35.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:35.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:35.767+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:36.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:36.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:36.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:36.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:37.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:37.354+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:37.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:37.706+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:38.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:38.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:38.693 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:38.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:39.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:39.299+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:39.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:39.723+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:40.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:40.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:40.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:40.729+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:41.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:41.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:41.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:41.707+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:42.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:42.405+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:42.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:42.694+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:43.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:43.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:43.651 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:43.649+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:44.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:44.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:44.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:44.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:45.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:45.331+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:45.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:45.716+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:46.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:46.288+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:46.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:46.755+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:47.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:47.315+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:47.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:47.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:48.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:48.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:48.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:48.708+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:49.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:49.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:49.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:49.710+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:50.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:50.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:50.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:50.714+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:51.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:51.251+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:51.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:51.757+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:52.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:52.279+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:52.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:52.792+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:53.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:53.314+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:53.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:53.836+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:54.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:54.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:54.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:54.814+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:55.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:55.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:55.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:55.776+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:56.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:56.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:56.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:56.757+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:57.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:57.267+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:57.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:57.757+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:58.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:58.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:58.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:58.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:59.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:30:59.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:30:59.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:30:59.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:00.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:00.253+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:00.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:00.774+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:01.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:01.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:01.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:01.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:02.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:02.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:02.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:02.800+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:03.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:03.217+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:03.781 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:03.780+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:04.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:04.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:04.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:04.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:05.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:05.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:05.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:05.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:06.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:06.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:06.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:06.786+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:07.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:07.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:07.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:07.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:08.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:08.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:08.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:08.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:09.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:09.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:09.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:09.721+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:10.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:10.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:10.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:10.702+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:11.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:11.151+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:11.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:11.729+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:12.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:12.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:12.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:12.774+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:13.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:13.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:13.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:13.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:14.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:14.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:14.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:14.729+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:15.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:15.267+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:15.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:15.756+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:16.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:16.263+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:16.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:16.788+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:17.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:17.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:17.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:17.830+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:18.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:18.251+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:18.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:18.838+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:19.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:19.271+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:19.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:19.877+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:20.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:20.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:20.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:20.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:21.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:21.301+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:21.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:21.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:22.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:22.288+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:22.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:22.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:23.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:23.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:23.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:23.904+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:24.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:24.285+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:24.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:24.950+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:25.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:25.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:25.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:25.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:26.337 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:26.335+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:26.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:26.931+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:27.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:27.385+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:27.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:27.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:28.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:28.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:28.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:28.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:29.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:29.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:29.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:29.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:30.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:30.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:30.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:30.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:31.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:31.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:31.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:31.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:32.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:32.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:32.975 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:32.973+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:33.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:33.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:33.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:33.938+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:34.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:34.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:34.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:34.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:35.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:35.564+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:35.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:35.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:36.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:36.611+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:36.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:36.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:37.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:37.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:38.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:38.033+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:38.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:38.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:38.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:38.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:39.633 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:39.631+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:40.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:40.023+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:40.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:40.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:41.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:41.059+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:41.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:41.571+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:42.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:42.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:42.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:42.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:43.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:43.084+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:43.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:43.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:44.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:44.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:44.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:44.550+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:45.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:45.098+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:45.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:45.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:46.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:46.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:46.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:46.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:47.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:47.075+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:47.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:47.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:48.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:48.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:48.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:48.451+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:49.077 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:49.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:49.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:49.453+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:50.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:50.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:50.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:50.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:51.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:51.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:51.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:51.484+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:52.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:52.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:52.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:52.532+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:53.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:53.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:53.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:53.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:54.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:54.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:54.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:54.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:55.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:55.182+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:55.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:55.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:56.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:56.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:56.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:56.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:57.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:57.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:57.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:57.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:58.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:58.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:58.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:58.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:59.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:31:59.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:31:59.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:31:59.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:00.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:00.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:00.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:00.484+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:01.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:01.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:01.448 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:01.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:02.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:02.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:02.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:02.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:03.138 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:03.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:03.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:03.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:04.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:04.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:04.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:04.475+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:05.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:05.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:05.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:05.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:06.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:06.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:06.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:06.515+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:07.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:07.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:07.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:07.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:08.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:08.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:08.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:08.556+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:09.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:09.103+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:09.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:09.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:10.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:10.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:10.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:10.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:11.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:11.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:11.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:11.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:12.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:12.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:12.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:12.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:13.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:13.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:13.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:13.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:14.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:14.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:14.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:14.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:15.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:15.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:15.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:15.538+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:16.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:16.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:16.561 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:16.560+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:17.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:17.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:17.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:17.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:18.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:18.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:18.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:18.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:19.077 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:19.075+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:19.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:19.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:20.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:20.092+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:20.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:20.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:21.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:21.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:21.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:21.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:22.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:22.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:22.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:22.556+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:23.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:23.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:23.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:23.542+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:24.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:24.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:24.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:24.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:25.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:25.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:25.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:25.568+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:26.138 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:26.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:26.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:26.580+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:27.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:27.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:27.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:27.532+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:28.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:28.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:28.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:28.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:29.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:29.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:29.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:29.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:30.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:30.215+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:30.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:30.554+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:31.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:31.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:31.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:31.571+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:32.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:32.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:32.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:32.607+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:33.215 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:33.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:33.651 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:33.650+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:34.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:34.234+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:34.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:34.651+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:35.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:35.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:35.668 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:35.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:36.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:36.206+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:36.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:36.694+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:37.245 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:37.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:37.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:37.740+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:38.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:38.202+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:38.786 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:38.784+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:39.225 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:39.223+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:39.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:39.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:40.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:40.242+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:40.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:40.776+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:41.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:41.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:41.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:41.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:42.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:42.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:42.857 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:42.855+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:43.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:43.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:43.833 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:43.831+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:44.215 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:44.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:44.872 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:44.870+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:45.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:45.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:45.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:45.834+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:46.175 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:46.174+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:46.872 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:46.870+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:47.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:47.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:47.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:47.888+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:48.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:48.206+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:48.867 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:48.865+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:49.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:49.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:49.869 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:49.867+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:50.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:50.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:50.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:50.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:51.138 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:51.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:51.881 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:51.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:52.171 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:52.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:52.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:52.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:53.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:53.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:53.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:53.895+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:54.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:54.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:54.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:54.884+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:55.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:55.126+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:55.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:55.913+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:56.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:56.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:56.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:56.956+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:57.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:57.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:57.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:57.977+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:58.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:58.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:58.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:58.971+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:59.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:32:59.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:32:59.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:32:59.942+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:00.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:00.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:00.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:00.894+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:01.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:01.044+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:01.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:01.922+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:02.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:02.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:02.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:02.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:03.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:03.039+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:03.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:03.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:04.053 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:04.051+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:04.918 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:04.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:05.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:05.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:05.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:05.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:06.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:06.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:06.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:06.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:07.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:07.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:07.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:07.943+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:08.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:08.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:08.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:08.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:09.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:09.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:09.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:09.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:10.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:10.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:10.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:10.942+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:11.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:11.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:11.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:11.946+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:12.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:12.128+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:12.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:12.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:13.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:13.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:14.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:14.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:14.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:14.065+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:15.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:15.048+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:15.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:15.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:16.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:16.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:16.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:16.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:17.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:17.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:17.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:17.121+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:18.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:18.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:18.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:18.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:19.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:19.053+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:19.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:19.109+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:20.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:20.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:20.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:20.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:21.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:21.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:21.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:21.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:22.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:22.096+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:22.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:22.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:23.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:23.053+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:23.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:23.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:24.066 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:24.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:24.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:24.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:25.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:25.060+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:25.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:25.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:26.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:26.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:26.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:26.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:27.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:27.066+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:27.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:27.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:28.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:28.027+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:28.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:28.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:29.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:29.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:29.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:29.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:30.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:30.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:30.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:30.208+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:31.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:31.119+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:31.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:31.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:32.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:32.146+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:32.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:32.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:33.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:33.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:33.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:33.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:34.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:34.152+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:34.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:34.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:35.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:35.144+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:35.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:35.225+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:36.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:36.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:36.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:36.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:37.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:37.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:37.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:37.271+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:38.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:38.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:38.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:38.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:39.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:39.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:39.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:39.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:40.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:40.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:40.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:40.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:41.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:41.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:41.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:41.163+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:42.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:42.167+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:42.202 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:42.201+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:43.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:43.184+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:43.223 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:43.221+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:44.207 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:44.205+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:44.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:44.221+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:45.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:45.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:45.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:45.227+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:46.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:46.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:46.223 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:46.222+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:47.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:47.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:47.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:47.219+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:48.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:48.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:48.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:48.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:49.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:49.185+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:49.207 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:49.205+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:50.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:50.217+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:50.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:50.218+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:51.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:51.211+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:51.232 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:51.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:52.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:52.204+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:52.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:52.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:53.202 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:53.201+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:53.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:53.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:54.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:54.218+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:54.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:54.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:55.233 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:55.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:55.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:55.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:56.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:56.238+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:56.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:56.264+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:57.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:57.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:57.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:57.310+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:58.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:58.204+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:58.292 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:58.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:59.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:33:59.230+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:33:59.290 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:33:59.289+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:00.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:00.207+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:00.292 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:00.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:01.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:01.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:01.322 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:01.322+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:02.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:02.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:02.316 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:02.315+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:03.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:03.274+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:03.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:03.277+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:04.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:04.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:04.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:04.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:05.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:05.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:05.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:05.333+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:06.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:06.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:06.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:06.294+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:07.280 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:07.278+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:07.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:07.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:08.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:08.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:08.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:08.300+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:09.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:09.264+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:09.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:09.281+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:10.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:10.232+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:10.239 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:10.238+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:11.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:11.246+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:11.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:11.275+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:12.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:12.276+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:12.307 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:12.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:13.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:13.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:13.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:13.312+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:14.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:14.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:14.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:14.277+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:15.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:15.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:15.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:15.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:16.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:16.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:16.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:16.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:17.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:17.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:17.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:17.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:18.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:18.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:18.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:18.321+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:19.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:19.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:19.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:19.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:20.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:20.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:20.309 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:20.308+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:21.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:21.261+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:21.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:21.320+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:22.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:22.281+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:22.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:22.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:23.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:23.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:23.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:23.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:24.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:24.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:24.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:24.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:25.282 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:25.281+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:25.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:25.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:26.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:26.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:26.307 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:26.305+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:27.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:27.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:27.325 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:27.324+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:28.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:28.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:28.375 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:28.374+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:29.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:29.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:29.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:29.365+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:30.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:30.256+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:30.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:30.330+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:31.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:31.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:31.327 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:31.325+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:32.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:32.243+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:32.331 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:32.330+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:33.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:33.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:33.367 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:33.366+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:34.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:34.207+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:34.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:34.403+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:35.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:35.174+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:35.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:35.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:36.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:36.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:36.401 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:36.401+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:37.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:37.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:37.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:37.383+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:38.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:38.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:38.341 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:38.341+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:39.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:39.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:39.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:39.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:40.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:40.167+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:40.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:40.322+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:41.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:41.119+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:41.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:41.363+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:42.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:42.115+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:42.397 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:42.396+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:43.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:43.144+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:43.370 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:43.369+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:44.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:44.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:44.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:44.322+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:45.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:45.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:45.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:45.305+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:46.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:46.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:46.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:46.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:47.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:47.011+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:47.285 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:47.283+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:48.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:48.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:48.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:48.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:48.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:48.978+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:49.303 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:49.301+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:49.931 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:49.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:50.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:50.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:50.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:50.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:51.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:51.321+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:51.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:51.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:52.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:52.299+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:52.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:52.934+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:53.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:53.256+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:53.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:53.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:54.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:54.299+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:54.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:54.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:55.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:55.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:55.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:55.912+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:56.286 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:56.284+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:56.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:56.864+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:57.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:57.299+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:57.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:57.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:58.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:58.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:58.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:58.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:59.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:34:59.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:34:59.878 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:34:59.876+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:00.269 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:00.267+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:00.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:00.832+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:01.274 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:01.272+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:01.869 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:01.868+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:02.286 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:02.284+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:02.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:02.834+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:03.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:03.299+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:03.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:03.869+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:04.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:04.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:04.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:04.901+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:05.382 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:05.380+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:05.903 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:05.901+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:06.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:06.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:06.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:06.864+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:07.334 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:07.332+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:07.865 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:07.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:08.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:08.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:08.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:08.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:09.270 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:09.269+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:09.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:09.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:10.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:10.267+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:10.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:10.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:11.238 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:11.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:11.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:11.887+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:12.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:12.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:12.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:12.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:13.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:13.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:13.881 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:13.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:14.297 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:14.295+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:14.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:14.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:15.264 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:15.262+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:15.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:15.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:16.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:16.234+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:16.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:16.996+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:17.199 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:17.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:18.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:18.039+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:18.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:18.163+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:19.008 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:19.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:19.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:19.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:20.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:20.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:20.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:20.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:21.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:21.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:21.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:21.143+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:22.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:22.077+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:22.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:22.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:23.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:23.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:23.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:23.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:24.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:24.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:24.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:24.182+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:25.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:25.137+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:25.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:25.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:26.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:26.165+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:26.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:26.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:27.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:27.124+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:27.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:27.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:28.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:28.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:28.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:28.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:29.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:29.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:29.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:29.155+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:30.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:30.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:30.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:30.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:31.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:31.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:31.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:31.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:32.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:32.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:32.175 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:32.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:33.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:33.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:33.179 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:33.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:34.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:34.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:34.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:34.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:35.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:35.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:35.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:35.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:36.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:36.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:36.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:36.155+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:37.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:37.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:37.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:37.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:38.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:38.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:38.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:38.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:39.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:39.054+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:39.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:39.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:40.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:40.017+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:40.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:40.100+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:41.052 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:41.050+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:41.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:41.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:42.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:42.075+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:42.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:42.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:43.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:43.067+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:43.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:43.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:44.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:44.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:44.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:44.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:45.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:45.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:45.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:45.138+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:46.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:46.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:46.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:46.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:47.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:47.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:47.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:47.170+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:48.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:48.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:48.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:48.195+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:49.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:49.062+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:49.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:49.177+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:50.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:50.042+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:50.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:50.135+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:51.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:51.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:51.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:51.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:52.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:52.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:52.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:52.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:53.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:53.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:53.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:53.136+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:54.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:54.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:54.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:54.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:55.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:55.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:55.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:55.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:56.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:56.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:56.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:56.165+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:57.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:57.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:57.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:57.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:58.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:58.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:58.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:58.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:59.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:35:59.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:35:59.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:35:59.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:00.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:00.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:00.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:00.069+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:01.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:01.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:01.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:01.109+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:02.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:02.054+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:02.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:02.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:03.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:03.057+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:03.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:03.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:04.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:04.060+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:04.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:04.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:05.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:05.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:05.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:05.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:05.981 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:05.981+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:06.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:06.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:07.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:07.022+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:07.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:07.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:08.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:08.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:08.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:08.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:09.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:09.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:09.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:09.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:10.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:10.084+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:10.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:10.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:11.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:11.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:11.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:11.079+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:12.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:12.066+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:12.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:12.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:13.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:13.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:13.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:13.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:14.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:14.032+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:14.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:14.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:15.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:15.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:15.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:15.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:16.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:16.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:16.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:16.099+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:17.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:17.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:17.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:17.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:18.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:18.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:18.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:18.124+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:19.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:19.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:19.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:19.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:20.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:20.098+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:20.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:20.129+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:21.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:21.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:21.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:21.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:22.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:22.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:22.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:22.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:23.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:23.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:23.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:23.135+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:24.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:24.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:24.175 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:24.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:25.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:25.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:25.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:25.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:26.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:26.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:26.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:26.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:27.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:27.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:27.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:27.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:28.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:28.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:28.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:28.204+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:29.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:29.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:29.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:29.234+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:30.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:30.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:30.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:30.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:31.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:31.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:31.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:31.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:32.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:32.175+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:32.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:32.189+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:33.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:33.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:33.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:33.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:34.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:34.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:34.264 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:34.262+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:35.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:35.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:35.218 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:35.216+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:36.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:36.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:36.229 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:36.227+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:37.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:37.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:37.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:37.271+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:38.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:38.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:38.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:38.256+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:39.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:39.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:39.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:39.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:40.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:40.138+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:40.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:40.338+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:41.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:41.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:41.342 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:41.340+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:42.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:42.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:42.309 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:42.307+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:43.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:43.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:43.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:43.349+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:44.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:44.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:44.304 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:44.302+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:45.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:45.099+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:45.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:45.352+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:46.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:46.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:46.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:46.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:47.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:47.103+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:47.328 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:47.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:48.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:48.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:48.319 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:48.318+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:49.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:49.129+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:49.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:49.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:50.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:50.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:50.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:50.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:51.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:51.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:51.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:51.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:52.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:52.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:52.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:52.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:53.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:53.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:53.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:53.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:54.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:54.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:54.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:54.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:55.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:55.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:55.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:55.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:56.184 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:56.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:56.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:56.184+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:57.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:57.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:57.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:57.215+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:58.171 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:58.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:58.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:58.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:59.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:36:59.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:36:59.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:36:59.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:00.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:00.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:00.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:00.179+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:01.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:01.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:01.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:01.179+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:02.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:02.175+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:02.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:02.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:03.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:03.165+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:03.203 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:03.202+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:04.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:04.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:04.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:04.201+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:05.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:05.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:05.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:05.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:06.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:06.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:06.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:06.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:07.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:07.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:07.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:07.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:08.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:08.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:08.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:08.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:09.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:09.145+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:09.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:09.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:10.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:10.161+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:10.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:10.216+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:11.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:11.140+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:11.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:11.253+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:12.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:12.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:12.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:12.236+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:13.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:13.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:13.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:13.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:14.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:14.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:14.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:14.226+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:15.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:15.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:15.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:15.248+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:16.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:16.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:16.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:16.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:17.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:17.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:17.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:17.261+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:18.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:18.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:18.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:18.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:19.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:19.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:19.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:19.278+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:20.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:20.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:20.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:20.299+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:21.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:21.215+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:21.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:21.275+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:22.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:22.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:22.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:22.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:23.280 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:23.278+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:23.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:23.308+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:24.261 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:24.259+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:24.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:24.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:25.232 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:25.231+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:25.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:25.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:26.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:26.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:26.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:26.311+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:27.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:27.245+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:27.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:27.333+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:28.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:28.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:28.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:28.379+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:29.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:29.208+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:29.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:29.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:30.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:30.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:30.332 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:30.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:31.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:31.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:31.314 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:31.313+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:32.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:32.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:32.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:32.358+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:33.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:33.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:33.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:33.326+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:34.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:34.152+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:34.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:34.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:35.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:35.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:35.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:35.326+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:36.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:36.109+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:36.312 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:36.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:37.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:37.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:37.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:37.358+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:38.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:38.067+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:38.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:38.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:39.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:39.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:39.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:39.384+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:40.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:40.098+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:40.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:40.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:41.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:41.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:41.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:41.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:42.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:42.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:42.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:42.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:43.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:43.092+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:43.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:43.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:44.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:44.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:44.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:44.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:45.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:45.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:45.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:45.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:46.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:46.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:46.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:46.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:47.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:47.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:47.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:47.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:48.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:48.184+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:48.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:48.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:49.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:49.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:49.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:49.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:50.203 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:50.201+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:50.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:50.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:51.233 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:51.231+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:51.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:51.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:52.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:52.224+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:52.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:52.575+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:53.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:53.218+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:53.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:53.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:54.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:54.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:54.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:54.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:55.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:55.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:55.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:55.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:56.261 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:56.259+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:56.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:56.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:57.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:57.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:57.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:57.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:58.327 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:58.326+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:58.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:58.475+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:59.297 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:37:59.295+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:37:59.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:37:59.447+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:00.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:00.288+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:00.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:00.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:01.328 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:01.327+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:01.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:01.438+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:02.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:02.357+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:02.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:02.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:03.329 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:03.327+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:03.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:03.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:04.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:04.349+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:04.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:04.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:05.386 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:05.383+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:05.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:05.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:06.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:06.365+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:06.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:06.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:07.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:07.357+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:07.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:07.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:08.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:08.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:08.396 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:08.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:09.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:09.337+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:09.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:09.358+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:10.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:10.319+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:10.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:10.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:11.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:11.283+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:11.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:11.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:12.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:12.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:12.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:12.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:13.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:13.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:13.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:13.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:14.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:14.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:14.327 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:14.326+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:15.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:15.330+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:15.335 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:15.334+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:16.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:16.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:16.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:16.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:17.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:17.283+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:17.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:17.335+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:18.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:18.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:18.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:18.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:19.279 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:19.278+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:19.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:19.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:20.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:20.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:20.421 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:20.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:21.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:21.297+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:21.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:21.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:22.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:22.337+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:22.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:22.431+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:23.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:23.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:23.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:23.388+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:24.346 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:24.345+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:24.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:24.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:25.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:25.338+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:25.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:25.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:26.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:26.322+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:26.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:26.389+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:27.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:27.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:27.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:27.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:28.316 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:28.314+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:28.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:28.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:29.295 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:29.293+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:29.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:29.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:30.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:30.263+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:30.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:30.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:31.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:31.234+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:31.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:31.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:32.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:32.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:32.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:32.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:33.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:33.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:33.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:33.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:34.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:34.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:34.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:34.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:35.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:35.211+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:35.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:35.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:36.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:36.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:36.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:36.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:37.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:37.242+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:37.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:37.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:38.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:38.256+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:38.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:38.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:39.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:39.206+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:39.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:39.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:40.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:40.231+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:40.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:40.494+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:41.261 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:41.259+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:41.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:41.515+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:42.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:42.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:42.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:42.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:43.240 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:43.238+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:43.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:43.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:44.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:44.219+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:44.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:44.516+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:45.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:45.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:45.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:45.556+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:46.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:46.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:46.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:46.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:47.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:47.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:47.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:47.607+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:48.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:48.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:48.657 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:48.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:49.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:49.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:49.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:49.684+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:50.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:50.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:50.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:50.642+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:51.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:51.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:51.632 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:51.630+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:52.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:52.144+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:52.674 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:52.672+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:53.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:53.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:53.674 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:53.672+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:54.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:54.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:54.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:54.709+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:55.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:55.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:55.752 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:55.751+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:56.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:56.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:56.771 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:56.770+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:57.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:57.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:57.800 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:57.799+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:58.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:58.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:58.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:58.758+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:59.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:38:59.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:38:59.746 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:38:59.745+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:00.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:00.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:00.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:00.748+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:01.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:01.050+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:01.735 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:01.734+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:02.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:02.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:02.756 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:02.755+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:03.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:03.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:03.732 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:03.731+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:04.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:04.075+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:04.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:04.700+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:05.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:05.029+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:05.741 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:05.740+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:06.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:06.038+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:06.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:06.723+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:07.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:07.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:07.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:07.743+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:08.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:08.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:08.793 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:08.791+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:09.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:09.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:09.797 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:09.795+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:10.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:10.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:10.828 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:10.826+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:11.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:11.126+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:11.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:11.869+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:12.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:12.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:12.828 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:12.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:13.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:13.052+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:13.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:13.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:14.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:14.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:14.926 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:14.925+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:15.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:15.067+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:15.903 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:15.901+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:16.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:16.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:16.879 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:16.877+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:17.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:17.069+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:17.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:17.838+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:18.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:18.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:18.830 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:18.828+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:19.104 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:19.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:19.845 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:19.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:20.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:20.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:20.830 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:20.829+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:21.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:21.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:21.847 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:21.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:22.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:22.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:22.867 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:22.865+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:23.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:23.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:23.833 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:23.831+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:24.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:24.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:24.869 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:24.867+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:25.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:25.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:25.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:25.873+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:26.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:26.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:26.828 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:26.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:27.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:27.103+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:27.839 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:27.837+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:28.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:28.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:28.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:28.830+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:29.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:29.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:29.838 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:29.835+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:30.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:30.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:30.820 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:30.818+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:31.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:31.236+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:31.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:31.813+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:32.251 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:32.249+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:32.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:32.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:33.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:33.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:33.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:33.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:34.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:34.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:34.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:34.860+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:35.271 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:35.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:35.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:35.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:36.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:36.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:36.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:36.833+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:37.282 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:37.280+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:37.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:37.872+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:38.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:38.271+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:38.879 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:38.877+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:39.317 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:39.315+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:39.838 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:39.837+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:40.363 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:40.362+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:40.809 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:40.808+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:41.385 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:41.384+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:41.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:41.797+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:42.373 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:42.372+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:42.750 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:42.749+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:43.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:43.398+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:43.788 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:43.787+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:44.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:44.391+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:44.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:44.743+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:45.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:45.412+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:45.699 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:45.699+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:46.412 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:46.412+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:46.729 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:46.729+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:47.368 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:47.368+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:47.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:47.766+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:48.374 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:48.373+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:48.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:48.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:49.327 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:49.326+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:49.727 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:49.726+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:50.362 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:50.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:50.714 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:50.714+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:51.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:51.345+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:51.710 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:51.708+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:52.370 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:52.368+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:52.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:52.737+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:53.385 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:53.383+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:53.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:53.773+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:54.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:54.347+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:54.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:54.744+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:55.316 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:55.315+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:55.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:55.724+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:56.311 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:56.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:56.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:56.759+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:57.358 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:57.356+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:57.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:57.746+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:58.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:58.359+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:58.741 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:58.739+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:59.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:39:59.332+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:39:59.788 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:39:59.787+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:00.345 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:00.343+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:00.829 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:00.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:01.328 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:01.326+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:01.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:01.825+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:02.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:02.297+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:02.804 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:02.802+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:03.318 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:03.316+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:03.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:03.825+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:04.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:04.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:04.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:04.831+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:05.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:05.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:05.860 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:05.859+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:06.260 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:06.259+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:06.881 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:06.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:07.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:07.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:07.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:07.914+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:08.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:08.275+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:08.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:08.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:09.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:09.275+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:09.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:09.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:10.244 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:10.242+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:11.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:11.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:11.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:11.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:12.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:12.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:12.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:12.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:13.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:13.008+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:13.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:13.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:14.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:14.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:14.199 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:14.197+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:15.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:15.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:15.215 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:15.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:16.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:16.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:16.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:16.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:17.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:17.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:17.229 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:17.227+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:18.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:18.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:18.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:18.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:19.027 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:19.025+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:19.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:19.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:20.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:20.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:20.197 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:20.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:21.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:21.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:21.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:21.152+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:21.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:21.991+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:22.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:22.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:22.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:22.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:23.215 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:23.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:24.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:24.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:24.191 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:24.190+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:25.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:25.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:25.176 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:25.176+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:26.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:26.027+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:26.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:26.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:26.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:26.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:27.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:27.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:27.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:27.958+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:28.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:28.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:28.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:28.988+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:29.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:29.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:30.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:30.030+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:30.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:30.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:30.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:30.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:31.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:31.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:31.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:31.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:32.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:32.057+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:32.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:32.988+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:33.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:33.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:34.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:34.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:34.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:34.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:35.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:35.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:35.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:35.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:36.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:36.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:36.053 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:36.052+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:37.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:37.016+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:37.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:37.060+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:37.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:37.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:38.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:38.068+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:38.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:38.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:39.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:39.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:39.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:39.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:40.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:40.048+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:40.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:40.973+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:41.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:41.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:41.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:41.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:42.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:42.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:42.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:42.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:43.053 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:43.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:43.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:43.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:44.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:44.079+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:45.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:45.032+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:45.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:45.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:46.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:46.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:46.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:46.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:47.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:47.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:47.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:47.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:48.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:48.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:48.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:48.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:49.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:49.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:49.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:49.128+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:50.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:50.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:50.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:50.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:50.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:50.993+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:51.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:51.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:52.008 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:52.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:52.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:52.109+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:53.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:53.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:53.145 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:53.143+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:54.029 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:54.027+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:54.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:54.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:55.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:55.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:55.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:55.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:55.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:55.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:56.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:56.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:56.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:56.961+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:57.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:57.225+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:57.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:57.991+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:58.199 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:58.197+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:58.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:58.996+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:59.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:40:59.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:40:59.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:40:59.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:00.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:00.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:01.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:01.016+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:01.224 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:01.222+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:02.066 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:02.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:02.261 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:02.259+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:03.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:03.095+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:03.309 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:03.308+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:04.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:04.062+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:04.355 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:04.354+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:05.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:05.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:05.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:05.352+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:06.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:06.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:06.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:06.314+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:07.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:07.122+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:07.327 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:07.326+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:08.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:08.099+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:08.368 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:08.367+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:09.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:09.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:09.390 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:09.389+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:10.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:10.184+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:10.433 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:10.432+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:11.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:11.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:11.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:11.426+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:12.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:12.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:12.459 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:12.458+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:13.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:13.168+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:13.420 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:13.419+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:14.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:14.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:14.400 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:14.399+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:15.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:15.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:15.431 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:15.431+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:16.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:16.140+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:16.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:16.443+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:17.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:17.151+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:17.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:17.460+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:18.151 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:18.149+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:18.427 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:18.425+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:19.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:19.198+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:19.468 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:19.466+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:20.151 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:20.149+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:20.487 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:20.486+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:21.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:21.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:21.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:21.441+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:22.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:22.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:22.410 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:22.409+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:23.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:23.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:23.429 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:23.427+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:24.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:24.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:24.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:24.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:25.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:25.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:25.409 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:25.406+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:25.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:25.992+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:26.390 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:26.388+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:27.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:27.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:27.363 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:27.362+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:28.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:28.027+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:28.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:28.382+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:29.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:29.018+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:29.363 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:29.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:29.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:29.992+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:30.388 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:30.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:30.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:30.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:31.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:31.338+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:31.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:31.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:32.346 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:32.344+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:32.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:32.996+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:33.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:33.389+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:34.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:34.022+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:34.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:34.400+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:35.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:35.017+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:35.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:35.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:35.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:35.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:36.436 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:36.434+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:36.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:36.978+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:37.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:37.443+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:37.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:37.943+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:38.464 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:38.462+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:38.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:38.955+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:39.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:39.478+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:39.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:39.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:40.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:40.438+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:41.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:41.015+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:41.410 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:41.408+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:42.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:42.048+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:42.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:42.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:43.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:43.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:43.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:43.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:44.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:44.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:44.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:44.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:45.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:45.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:45.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:45.502+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:46.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:46.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:46.475 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:46.474+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:47.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:47.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:47.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:47.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:48.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:48.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:48.455 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:48.453+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:49.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:49.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:49.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:49.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:50.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:50.149+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:50.532 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:50.531+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:51.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:51.180+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:51.501 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:51.501+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:52.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:52.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:52.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:52.518+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:53.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:53.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:53.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:53.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:54.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:54.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:54.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:54.560+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:55.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:55.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:55.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:55.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:56.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:56.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:56.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:56.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:57.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:57.125+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:57.544 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:57.543+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:58.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:58.079+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:58.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:58.568+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:59.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:41:59.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:41:59.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:41:59.611+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:00.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:00.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:00.656 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:00.655+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:01.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:01.096+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:01.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:01.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:02.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:02.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:02.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:02.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:03.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:03.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:03.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:03.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:04.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:04.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:04.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:04.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:05.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:05.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:05.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:05.680+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:06.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:06.117+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:06.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:06.660+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:07.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:07.082+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:07.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:07.700+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:08.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:08.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:08.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:08.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:09.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:09.095+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:09.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:09.717+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:10.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:10.079+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:10.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:10.732+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:11.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:11.100+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:11.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:11.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:12.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:12.065+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:12.740 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:12.738+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:13.053 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:13.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:13.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:13.701+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:14.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:14.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:14.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:14.707+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:15.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:15.139+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:15.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:15.749+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:16.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:16.100+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:16.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:16.757+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:17.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:17.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:17.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:17.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:18.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:18.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:18.669 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:18.667+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:19.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:19.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:19.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:19.716+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:20.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:20.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:20.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:20.736+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:21.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:21.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:21.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:21.737+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:21.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:21.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:22.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:22.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:23.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:23.023+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:23.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:23.677+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:24.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:24.001+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:24.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:24.723+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:24.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:24.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:25.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:25.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:25.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:25.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:26.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:26.714+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:26.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:26.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:27.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:27.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:27.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:27.948+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:28.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:28.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:28.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:28.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:29.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:29.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:30.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:30.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:30.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:30.780+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:30.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:30.996+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:31.738 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:31.736+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:32.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:32.033+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:32.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:32.735+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:33.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:33.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:33.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:33.733+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:34.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:34.068+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:34.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:34.783+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:35.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:35.055+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:35.817 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:35.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:36.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:36.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:36.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:36.862+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:37.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:37.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:37.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:37.879+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:38.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:38.170+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:38.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:38.863+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:39.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:39.146+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:39.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:39.829+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:40.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:40.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:40.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:40.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:41.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:41.167+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:41.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:41.817+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:42.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:42.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:42.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:42.818+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:43.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:43.180+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:43.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:43.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:44.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:44.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:44.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:44.797+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:45.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:45.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:45.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:45.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:46.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:46.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:46.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:46.808+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:47.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:47.130+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:47.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:47.839+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:48.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:48.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:48.815 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:48.814+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:49.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:49.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:49.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:49.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:50.246 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:50.244+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:50.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:50.819+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:51.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:51.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:51.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:51.794+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:52.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:52.247+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:52.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:52.817+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:53.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:53.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:53.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:53.772+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:54.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:54.236+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:54.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:54.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:55.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:55.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:55.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:55.785+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:56.325 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:56.323+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:56.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:56.796+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:57.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:57.348+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:57.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:57.788+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:58.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:58.374+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:58.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:58.791+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:59.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:42:59.425+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:42:59.792 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:42:59.790+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:00.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:00.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:00.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:00.838+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:01.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:01.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:01.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:01.838+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:02.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:02.462+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:02.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:02.881+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:03.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:03.434+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:03.854 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:03.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:04.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:04.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:04.813 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:04.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:05.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:05.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:05.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:05.856+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:06.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:06.405+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:06.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:06.819+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:07.448 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:07.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:07.799 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:07.797+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:08.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:08.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:08.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:08.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:09.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:09.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:09.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:09.785+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:10.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:10.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:10.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:10.804+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:11.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:11.434+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:11.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:11.803+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:12.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:12.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:12.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:12.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:13.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:13.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:13.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:13.825+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:14.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:14.448+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:14.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:14.859+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:15.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:15.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:15.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:15.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:16.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:16.453+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:16.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:16.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:17.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:17.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:17.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:17.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:18.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:18.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:18.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:18.919+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:19.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:19.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:19.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:19.937+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:20.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:20.416+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:20.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:20.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:21.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:21.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:21.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:21.962+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:22.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:22.413+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:22.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:22.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:23.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:23.374+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:23.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:23.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:24.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:24.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:24.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:24.973+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:25.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:25.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:25.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:25.942+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:26.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:26.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:26.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:26.910+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:27.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:27.407+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:27.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:27.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:28.421 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:28.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:28.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:28.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:29.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:29.435+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:29.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:29.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:30.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:30.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:30.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:30.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:31.463 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:31.461+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:31.937 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:31.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:32.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:32.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:32.987 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:32.986+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:33.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:33.443+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:33.973 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:33.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:34.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:34.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:34.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:34.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:35.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:35.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:35.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:35.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:36.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:36.580+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:36.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:36.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:37.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:37.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:38.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:38.009+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:38.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:38.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:39.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:39.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:39.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:39.622+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:40.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:40.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:40.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:40.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:40.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:40.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:41.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:41.589+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:41.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:41.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:42.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:42.618+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:43.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:43.000+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:43.601 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:43.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:43.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:43.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:44.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:44.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:44.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:44.993+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:45.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:45.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:46.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:46.034+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:46.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:46.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:47.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:47.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:47.561 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:47.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:48.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:48.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:48.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:48.572+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:49.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:49.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:49.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:49.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:50.104 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:50.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:50.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:50.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:51.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:51.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:51.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:51.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:52.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:52.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:52.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:52.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:53.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:53.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:53.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:53.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:54.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:54.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:54.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:54.596+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:55.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:55.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:55.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:55.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:56.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:56.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:56.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:56.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:57.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:57.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:57.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:57.564+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:58.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:58.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:58.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:58.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:59.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:43:59.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:43:59.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:43:59.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:00.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:00.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:00.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:00.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:01.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:01.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:01.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:01.484+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:02.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:02.080+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:02.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:02.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:03.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:03.045+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:03.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:03.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:04.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:04.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:04.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:04.447+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:05.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:05.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:05.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:05.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:06.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:06.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:06.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:06.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:07.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:07.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:07.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:07.532+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:08.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:08.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:08.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:08.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:09.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:09.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:09.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:09.574+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:10.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:10.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:10.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:10.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:11.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:11.069+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:11.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:11.546+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:12.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:12.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:12.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:12.591+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:13.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:13.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:13.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:13.564+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:14.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:14.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:14.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:14.560+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:15.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:15.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:15.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:15.611+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:16.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:16.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:16.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:16.650+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:17.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:17.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:17.678 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:17.676+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:18.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:18.026+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:18.712 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:18.710+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:19.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:19.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:19.718 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:19.713+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:19.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:19.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:20.756 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:20.754+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:20.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:20.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:21.711 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:21.709+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:21.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:21.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:22.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:22.690+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:23.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:23.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:23.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:23.723+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:23.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:23.969+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:24.726 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:24.724+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:24.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:24.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:25.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:25.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:25.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:25.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:26.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:26.760+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:26.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:26.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:27.780 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:27.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:27.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:27.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:28.825 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:28.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:29.029 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:29.027+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:29.804 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:29.802+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:30.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:30.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:30.796 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:30.794+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:31.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:31.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:31.828 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:31.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:32.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:32.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:32.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:32.821+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:33.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:33.025+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:33.801 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:33.799+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:34.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:34.001+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:34.796 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:34.794+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:35.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:35.033+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:35.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:35.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:36.000 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:35.998+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:36.835 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:36.833+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:37.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:37.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:37.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:37.789+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:38.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:38.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:38.803 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:38.801+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:39.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:39.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:39.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:39.776+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:40.054 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:40.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:40.773 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:40.772+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:41.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:41.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:41.817 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:41.815+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:42.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:42.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:42.810 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:42.808+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:43.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:43.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:43.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:43.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:44.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:44.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:44.814 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:44.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:45.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:45.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:45.854 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:45.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:46.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:46.007+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:46.835 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:46.834+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:46.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:46.967+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:47.808 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:47.807+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:47.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:47.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:48.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:48.857+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:48.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:48.929+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:49.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:49.889+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:49.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:49.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:50.851 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:50.850+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:50.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:50.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:51.873 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:51.872+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:52.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:52.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:52.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:52.873+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:53.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:53.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:53.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:53.884+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:54.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:54.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:54.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:54.907+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:55.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:55.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:55.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:55.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:56.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:56.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:56.864 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:56.862+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:57.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:57.045+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:57.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:57.842+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:58.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:58.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:58.814 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:58.812+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:59.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:44:59.045+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:44:59.829 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:44:59.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:00.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:00.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:00.782 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:00.780+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:01.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:01.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:01.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:01.741+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:02.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:02.034+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:02.710 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:02.709+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:03.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:03.017+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:03.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:03.732+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:04.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:04.025+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:04.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:04.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:05.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:05.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:05.780 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:05.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:06.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:06.068+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:06.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:06.758+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:07.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:07.115+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:07.738 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:07.737+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:08.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:08.075+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:08.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:08.690+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:09.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:09.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:09.734 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:09.732+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:10.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:10.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:10.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:10.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:11.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:11.001+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:11.750 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:11.748+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:11.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:11.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:12.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:12.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:12.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:12.951+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:13.818 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:13.816+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:14.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:14.000+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:14.867 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:14.865+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:15.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:15.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:15.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:15.846+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:16.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:16.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:16.850 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:16.848+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:17.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:17.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:17.856 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:17.855+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:18.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:18.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:18.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:18.878+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:19.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:19.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:19.910 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:19.908+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:20.145 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:20.144+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:20.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:20.945+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:21.179 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:21.177+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:21.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:21.934+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:22.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:22.188+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:22.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:22.892+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:23.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:23.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:23.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:23.934+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:24.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:24.229+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:24.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:24.923+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:25.223 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:25.221+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:25.910 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:25.908+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:26.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:26.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:26.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:26.888+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:27.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:27.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:27.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:27.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:28.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:28.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:28.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:28.885+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:29.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:29.243+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:29.872 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:29.871+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:30.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:30.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:30.876 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:30.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:31.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:31.242+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:31.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:31.874+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:32.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:32.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:32.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:32.901+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:33.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:33.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:33.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:33.943+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:34.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:34.163+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:34.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:34.900+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:35.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:35.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:35.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:35.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:36.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:36.199+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:36.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:36.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:37.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:37.184+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:37.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:37.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:38.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:38.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:38.998 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:38.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:39.191 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:39.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:40.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:40.003+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:40.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:40.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:40.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:40.992+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:41.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:41.219+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:42.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:42.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:42.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:42.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:43.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:43.028+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:43.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:43.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:43.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:43.980+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:44.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:44.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:44.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:44.949+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:45.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:45.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:45.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:45.950+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:46.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:46.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:46.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:46.928+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:47.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:47.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:47.913 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:47.912+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:48.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:48.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:48.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:48.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:49.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:49.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:49.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:49.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:50.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:50.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:50.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:50.925+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:51.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:51.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:51.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:51.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:52.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:52.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:52.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:52.971+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:53.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:53.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:54.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:54.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:54.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:54.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:55.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:55.016+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:55.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:55.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:56.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:56.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:56.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:56.140+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:57.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:57.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:57.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:57.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:58.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:58.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:58.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:58.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:59.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:45:59.086+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:45:59.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:45:59.219+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:00.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:00.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:00.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:00.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:01.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:01.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:01.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:01.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:02.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:02.067+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:02.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:02.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:03.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:03.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:03.290 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:03.288+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:04.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:04.117+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:04.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:04.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:05.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:05.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:05.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:05.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:06.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:06.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:06.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:06.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:07.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:07.124+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:07.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:07.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:08.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:08.122+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:08.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:08.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:09.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:09.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:09.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:09.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:10.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:10.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:10.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:10.225+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:11.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:11.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:11.264 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:11.263+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:12.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:12.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:12.307 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:12.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:13.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:13.138+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:13.357 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:13.356+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:14.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:14.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:14.402 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:14.401+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:15.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:15.183+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:15.392 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:15.391+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:16.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:16.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:16.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:16.363+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:17.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:17.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:17.388 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:17.388+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:18.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:18.159+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:18.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:18.360+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:19.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:19.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:19.360 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:19.359+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:20.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:20.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:20.344 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:20.343+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:21.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:21.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:21.303 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:21.302+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:22.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:22.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:22.343 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:22.343+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:23.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:23.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:23.370 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:23.368+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:24.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:24.196+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:24.349 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:24.347+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:25.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:25.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:25.373 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:25.371+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:26.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:26.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:26.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:26.397+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:27.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:27.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:27.415 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:27.413+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:28.203 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:28.201+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:28.412 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:28.411+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:29.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:29.222+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:29.375 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:29.373+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:30.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:30.216+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:30.401 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:30.399+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:31.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:31.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:31.435 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:31.434+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:32.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:32.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:32.469 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:32.467+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:33.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:33.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:33.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:33.501+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:34.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:34.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:34.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:34.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:35.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:35.300+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:35.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:35.494+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:36.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:36.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:36.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:36.483+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:37.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:37.362+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:37.467 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:37.465+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:38.401 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:38.399+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:38.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:38.443+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:39.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:39.388+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:39.488 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:39.486+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:40.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:40.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:40.514 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:40.513+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:41.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:41.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:41.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:41.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:42.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:42.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:42.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:42.565+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:43.352 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:43.350+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:43.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:43.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:44.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:44.314+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:44.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:44.574+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:45.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:45.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:45.535 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:45.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:46.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:46.247+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:46.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:46.494+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:47.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:47.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:47.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:47.451+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:48.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:48.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:48.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:48.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:49.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:49.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:49.490 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:49.488+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:50.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:50.220+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:50.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:50.528+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:51.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:51.211+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:51.487 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:51.486+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:52.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:52.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:52.482 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:52.480+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:53.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:53.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:53.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:53.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:54.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:54.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:54.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:54.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:55.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:55.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:55.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:55.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:56.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:56.208+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:56.555 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:56.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:57.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:57.184+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:57.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:57.543+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:58.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:58.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:58.546 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:58.546+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:59.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:46:59.151+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:46:59.521 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:46:59.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:00.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:00.108+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:00.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:00.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:01.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:01.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:01.473 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:01.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:02.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:02.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:02.467 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:02.467+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:03.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:03.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:03.509 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:03.508+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:04.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:04.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:04.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:04.556+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:05.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:05.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:05.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:05.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:06.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:06.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:06.514 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:06.512+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:07.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:07.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:07.491 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:07.489+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:08.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:08.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:08.530 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:08.528+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:09.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:09.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:09.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:09.527+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:10.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:10.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:10.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:10.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:11.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:11.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:11.523 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:11.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:12.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:12.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:12.526 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:12.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:13.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:13.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:13.516 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:13.515+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:14.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:14.151+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:14.523 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:14.521+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:15.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:15.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:15.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:15.564+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:16.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:16.222+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:16.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:16.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:17.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:17.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:17.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:17.507+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:18.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:18.224+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:18.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:18.491+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:19.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:19.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:19.450 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:19.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:20.295 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:20.293+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:20.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:20.476+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:21.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:21.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:21.441 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:21.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:22.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:22.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:22.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:22.411+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:23.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:23.367+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:23.385 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:23.383+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:24.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:24.415+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:24.423 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:24.421+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:25.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:25.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:25.450 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:25.448+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:26.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:26.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:26.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:26.451+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:27.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:27.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:27.434 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:27.432+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:28.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:28.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:28.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:28.460+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:29.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:29.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:29.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:29.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:30.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:30.349+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:30.490 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:30.488+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:31.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:31.384+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:31.540 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:31.538+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:32.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:32.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:32.563 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:32.561+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:33.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:33.357+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:33.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:33.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:34.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:34.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:34.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:34.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:35.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:35.380+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:35.524 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:35.522+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:36.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:36.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:36.515 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:36.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:37.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:37.368+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:37.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:37.501+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:38.336 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:38.336+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:38.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:38.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:39.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:39.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:39.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:39.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:40.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:40.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:40.497 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:40.496+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:41.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:41.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:41.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:41.533+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:42.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:42.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:42.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:42.555+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:43.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:43.180+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:43.552 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:43.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:44.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:44.218+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:44.528 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:44.528+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:45.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:45.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:45.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:45.568+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:46.246 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:46.245+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:46.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:46.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:47.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:47.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:47.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:47.556+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:48.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:48.244+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:48.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:48.574+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:49.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:49.264+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:49.577 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:49.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:50.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:50.247+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:50.609 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:50.608+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:51.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:51.232+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:51.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:51.594+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:52.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:52.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:52.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:52.602+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:53.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:53.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:53.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:53.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:54.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:54.277+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:54.565 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:54.563+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:55.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:55.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:55.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:55.609+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:56.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:56.251+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:56.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:56.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:57.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:57.266+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:57.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:57.564+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:58.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:58.256+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:58.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:58.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:59.228 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:47:59.226+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:47:59.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:47:59.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:00.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:00.272+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:00.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:00.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:01.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:01.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:01.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:01.630+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:02.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:02.258+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:02.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:02.616+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:03.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:03.271+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:03.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:03.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:04.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:04.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:04.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:04.683+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:05.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:05.281+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:05.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:05.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:06.265 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:06.263+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:06.688 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:06.686+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:07.309 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:07.307+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:07.738 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:07.736+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:08.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:08.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:08.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:08.717+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:09.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:09.281+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:09.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:09.679+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:10.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:10.255+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:10.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:10.695+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:11.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:11.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:11.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:11.673+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:12.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:12.215+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:12.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:12.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:13.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:13.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:13.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:13.728+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:14.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:14.244+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:14.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:14.779+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:15.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:15.287+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:15.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:15.771+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:16.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:16.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:16.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:16.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:17.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:17.351+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:17.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:17.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:18.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:18.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:18.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:18.767+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:19.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:19.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:19.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:19.773+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:20.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:20.289+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:20.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:20.813+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:21.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:21.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:21.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:21.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:22.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:22.315+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:22.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:22.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:23.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:23.362+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:23.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:23.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:24.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:24.380+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:24.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:24.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:25.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:25.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:25.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:25.800+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:26.353 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:26.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:26.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:26.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:27.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:27.361+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:27.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:27.783+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:28.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:28.367+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:28.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:28.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:29.320 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:29.320+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:29.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:29.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:30.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:30.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:30.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:30.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:31.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:31.295+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:31.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:31.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:32.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:32.302+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:32.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:32.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:33.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:33.270+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:33.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:33.779+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:34.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:34.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:34.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:34.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:35.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:35.246+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:35.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:35.723+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:36.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:36.276+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:36.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:36.710+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:37.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:37.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:37.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:37.677+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:38.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:38.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:38.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:38.725+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:39.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:39.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:39.704 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:39.702+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:40.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:40.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:40.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:40.746+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:41.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:41.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:41.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:41.763+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:42.386 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:42.385+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:42.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:42.812+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:43.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:43.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:43.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:43.796+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:44.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:44.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:44.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:44.846+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:45.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:45.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:45.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:45.848+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:46.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:46.383+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:46.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:46.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:47.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:47.354+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:47.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:47.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:48.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:48.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:48.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:48.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:49.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:49.380+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:49.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:49.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:50.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:50.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:50.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:50.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:51.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:51.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:51.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:51.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:52.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:52.416+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:52.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:52.851+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:53.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:53.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:53.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:53.896+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:54.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:54.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:54.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:54.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:55.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:55.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:55.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:55.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:56.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:56.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:56.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:56.869+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:57.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:57.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:57.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:57.846+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:58.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:58.423+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:58.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:58.817+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:59.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:48:59.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:48:59.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:48:59.848+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:00.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:00.411+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:00.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:00.891+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:01.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:01.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:01.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:01.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:02.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:02.421+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:02.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:02.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:03.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:03.429+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:03.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:03.841+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:04.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:04.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:04.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:04.876+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:05.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:05.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:05.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:05.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:06.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:06.407+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:06.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:06.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:07.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:07.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:07.854 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:07.853+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:08.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:08.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:08.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:08.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:09.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:09.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:09.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:09.827+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:10.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:10.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:10.820 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:10.819+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:11.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:11.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:11.829 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:11.828+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:12.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:12.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:12.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:12.821+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:13.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:13.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:13.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:13.804+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:14.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:14.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:14.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:14.807+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:15.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:15.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:15.760 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:15.759+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:16.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:16.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:16.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:16.804+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:17.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:17.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:17.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:17.784+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:18.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:18.434+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:18.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:18.764+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:19.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:19.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:19.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:19.735+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:20.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:20.461+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:20.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:20.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:21.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:21.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:21.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:21.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:22.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:22.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:22.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:22.700+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:23.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:23.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:23.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:23.714+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:24.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:24.487+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:24.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:24.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:25.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:25.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:25.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:25.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:26.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:26.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:26.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:26.709+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:27.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:27.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:27.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:27.687+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:28.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:28.358+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:28.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:28.701+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:29.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:29.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:29.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:29.695+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:30.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:30.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:30.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:30.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:31.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:31.462+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:31.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:31.659+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:32.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:32.435+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:32.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:32.638+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:33.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:33.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:33.593 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:33.591+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:34.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:34.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:34.619 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:34.617+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:35.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:35.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:35.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:35.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:36.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:36.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:36.701 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:36.699+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:37.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:37.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:37.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:37.706+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:38.601 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:38.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:38.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:38.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:39.626 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:39.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:39.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:39.721+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:40.622 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:40.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:40.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:40.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:41.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:41.642+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:41.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:41.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:42.662 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:42.660+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:42.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:42.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:43.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:43.621+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:43.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:43.681+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:44.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:44.633+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:44.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:44.670+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:45.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:45.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:45.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:45.632+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:46.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:46.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:46.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:46.631+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:47.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:47.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:47.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:47.659+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:48.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:48.605+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:48.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:48.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:49.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:49.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:49.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:49.667+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:50.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:50.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:50.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:50.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:51.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:51.555+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:51.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:51.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:52.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:52.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:52.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:52.745+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:53.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:53.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:53.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:53.795+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:54.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:54.601+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:54.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:54.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:55.573 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:55.572+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:55.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:55.794+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:56.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:56.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:56.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:56.777+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:57.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:57.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:57.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:57.731+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:58.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:58.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:58.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:58.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:59.586 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:49:59.585+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:49:59.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:49:59.736+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:00.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:00.585+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:00.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:00.687+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:01.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:01.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:01.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:01.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:02.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:02.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:02.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:02.704+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:03.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:03.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:03.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:03.665+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:04.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:04.524+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:04.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:04.709+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:05.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:05.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:05.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:05.666+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:06.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:06.564+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:06.648 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:06.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:07.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:07.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:07.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:07.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:08.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:08.580+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:08.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:08.648+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:09.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:09.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:09.648 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:09.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:10.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:10.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:10.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:10.618+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:11.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:11.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:11.653 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:11.651+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:12.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:12.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:12.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:12.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:13.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:13.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:13.663 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:13.661+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:14.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:14.582+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:14.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:14.706+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:15.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:15.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:15.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:15.657+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:16.649 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:16.647+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:16.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:16.696+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:17.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:17.662+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:17.676 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:17.675+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:18.626 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:18.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:18.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:18.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:19.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:19.606+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:19.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:19.704+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:20.656 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:20.654+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:20.720 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:20.718+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:21.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:21.630+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:21.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:21.683+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:22.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:22.629+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:22.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:22.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:23.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:23.582+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:23.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:23.724+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:24.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:24.561+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:24.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:24.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:25.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:25.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:25.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:25.694+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:26.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:26.538+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:26.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:26.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:27.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:27.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:27.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:27.688+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:28.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:28.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:28.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:28.653+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:29.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:29.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:29.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:29.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:30.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:30.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:30.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:30.597+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:31.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:31.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:31.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:31.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:32.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:32.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:32.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:32.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:33.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:33.353+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:33.538 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:33.537+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:34.382 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:34.381+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:34.525 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:34.525+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:35.409 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:35.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:35.477 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:35.476+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:36.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:36.448+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:36.477 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:36.476+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:37.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:37.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:37.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:37.502+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:38.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:38.411+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:38.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:38.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:39.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:39.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:39.485 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:39.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:40.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:40.437+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:40.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:40.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:41.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:41.445+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:41.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:41.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:42.448 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:42.447+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:42.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:42.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:43.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:43.411+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:43.554 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:43.552+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:44.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:44.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:44.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:44.597+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:45.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:45.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:45.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:45.590+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:46.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:46.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:46.619 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:46.617+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:47.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:47.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:47.651 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:47.649+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:48.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:48.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:48.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:48.633+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:49.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:49.374+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:49.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:49.590+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:50.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:50.357+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:50.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:50.597+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:51.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:51.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:51.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:51.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:52.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:52.325+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:52.546 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:52.544+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:53.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:53.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:53.528 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:53.526+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:54.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:54.279+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:54.545 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:54.543+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:55.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:55.283+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:55.525 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:55.523+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:56.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:56.244+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:56.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:56.549+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:57.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:57.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:57.598 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:57.596+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:58.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:58.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:58.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:58.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:59.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:50:59.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:50:59.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:50:59.624+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:00.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:00.249+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:00.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:00.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:01.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:01.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:01.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:01.640+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:02.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:02.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:02.641 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:02.640+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:03.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:03.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:03.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:03.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:04.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:04.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:04.621 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:04.619+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:05.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:05.267+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:05.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:05.585+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:06.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:06.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:06.552 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:06.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:07.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:07.202+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:07.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:07.535+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:08.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:08.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:08.508 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:08.506+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:09.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:09.181+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:09.522 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:09.520+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:10.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:10.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:10.512 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:10.510+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:11.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:11.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:11.557 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:11.555+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:12.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:12.208+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:12.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:12.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:13.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:13.233+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:13.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:13.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:14.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:14.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:14.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:14.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:15.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:15.158+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:15.561 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:15.560+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:16.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:16.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:16.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:16.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:17.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:17.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:17.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:17.609+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:18.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:18.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:18.589 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:18.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:19.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:19.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:19.558 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:19.557+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:20.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:20.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:20.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:20.566+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:21.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:21.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:21.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:21.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:22.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:22.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:22.508 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:22.507+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:23.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:23.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:23.505 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:23.504+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:24.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:24.233+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:24.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:24.498+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:25.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:25.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:25.491 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:25.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:26.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:26.288+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:26.501 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:26.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:27.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:27.314+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:27.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:27.527+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:28.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:28.362+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:28.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:28.504+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:29.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:29.342+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:29.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:29.549+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:30.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:30.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:30.529 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:30.527+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:31.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:31.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:31.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:31.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:32.382 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:32.380+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:32.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:32.497+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:33.415 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:33.413+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:33.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:33.546+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:34.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:34.378+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:34.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:34.585+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:35.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:35.379+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:35.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:35.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:36.391 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:36.389+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:36.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:36.664+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:37.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:37.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:37.630 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:37.628+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:38.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:38.410+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:38.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:38.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:39.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:39.368+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:39.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:39.677+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:40.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:40.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:40.641 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:40.640+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:41.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:41.374+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:41.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:41.597+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:42.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:42.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:42.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:42.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:43.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:43.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:43.615 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:43.614+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:44.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:44.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:44.598 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:44.596+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:45.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:45.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:45.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:45.585+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:46.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:46.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:46.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:46.618+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:47.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:47.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:47.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:47.622+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:48.281 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:48.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:48.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:48.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:49.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:49.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:49.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:49.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:50.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:50.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:50.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:50.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:51.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:51.296+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:51.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:51.666+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:52.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:52.336+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:52.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:52.674+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:53.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:53.333+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:53.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:53.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:54.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:54.356+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:54.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:54.642+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:55.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:55.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:55.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:55.644+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:56.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:56.303+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:56.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:56.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:57.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:57.349+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:57.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:57.726+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:58.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:58.342+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:58.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:58.726+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:59.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:51:59.312+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:51:59.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:51:59.695+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:00.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:00.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:00.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:00.700+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:01.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:01.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:01.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:01.690+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:02.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:02.301+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:02.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:02.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:03.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:03.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:03.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:03.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:04.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:04.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:04.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:04.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:05.330 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:05.328+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:05.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:05.710+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:06.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:06.283+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:06.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:06.736+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:07.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:07.249+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:07.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:07.709+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:08.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:08.300+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:08.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:08.680+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:09.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:09.314+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:09.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:09.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:10.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:10.313+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:10.656 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:10.654+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:11.282 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:11.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:11.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:11.677+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:12.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:12.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:12.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:12.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:13.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:13.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:13.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:13.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:14.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:14.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:14.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:14.767+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:15.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:15.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:15.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:15.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:16.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:16.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:16.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:16.774+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:17.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:17.361+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:17.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:17.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:18.321 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:18.319+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:18.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:18.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:19.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:19.301+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:19.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:19.755+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:20.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:20.337+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:20.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:20.796+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:21.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:21.295+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:21.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:21.823+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:22.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:22.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:22.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:22.851+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:23.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:23.259+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:23.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:23.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:24.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:24.303+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:24.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:24.883+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:25.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:25.278+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:25.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:25.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:26.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:26.248+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:26.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:26.795+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:27.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:27.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:27.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:27.785+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:28.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:28.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:28.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:28.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:29.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:29.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:29.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:29.803+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:30.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:30.207+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:30.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:30.826+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:31.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:31.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:31.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:31.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:32.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:32.258+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:32.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:32.881+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:33.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:33.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:33.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:33.910+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:34.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:34.303+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:34.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:34.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:35.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:35.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:35.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:35.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:36.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:36.363+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:36.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:36.961+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:37.382 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:37.381+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:37.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:37.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:38.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:38.429+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:38.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:38.937+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:39.448 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:39.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:39.973 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:39.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:40.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:40.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:40.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:40.967+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:41.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:41.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:41.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:41.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:42.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:42.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:42.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:42.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:43.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:43.362+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:43.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:43.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:44.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:44.358+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:44.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:44.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:45.397 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:45.396+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:45.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:45.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:46.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:46.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:46.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:46.915+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:47.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:47.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:47.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:47.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:48.355 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:48.354+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:48.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:48.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:49.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:49.377+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:49.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:49.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:50.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:50.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:50.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:50.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:51.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:51.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:51.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:51.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:52.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:52.404+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:52.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:52.950+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:53.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:53.402+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:53.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:53.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:54.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:54.439+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:55.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:55.016+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:55.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:55.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:56.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:56.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:56.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:56.461+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:57.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:57.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:57.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:57.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:58.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:58.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:58.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:58.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:59.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:52:59.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:52:59.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:52:59.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:00.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:00.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:00.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:00.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:01.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:01.115+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:01.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:01.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:02.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:02.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:02.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:02.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:03.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:03.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:03.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:03.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:04.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:04.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:04.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:04.576+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:05.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:05.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:05.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:05.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:06.199 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:06.197+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:06.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:06.591+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:07.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:07.206+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:07.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:07.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:08.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:08.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:08.601 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:08.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:09.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:09.217+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:09.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:09.640+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:10.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:10.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:10.599 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:10.597+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:11.225 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:11.223+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:11.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:11.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:12.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:12.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:12.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:12.611+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:13.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:13.206+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:13.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:13.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:14.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:14.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:14.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:14.601+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:15.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:15.241+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:15.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:15.564+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:16.201 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:16.199+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:16.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:16.533+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:17.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:17.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:17.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:17.554+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:18.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:18.224+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:18.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:18.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:19.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:19.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:19.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:19.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:20.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:20.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:20.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:20.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:21.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:21.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:21.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:21.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:22.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:22.134+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:22.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:22.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:23.176 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:23.174+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:23.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:23.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:24.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:24.208+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:24.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:24.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:25.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:25.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:25.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:25.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:26.203 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:26.202+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:26.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:26.508+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:27.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:27.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:27.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:27.542+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:28.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:28.215+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:28.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:28.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:29.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:29.264+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:29.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:29.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:30.274 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:30.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:30.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:30.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:31.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:31.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:31.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:31.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:32.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:32.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:32.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:32.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:33.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:33.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:33.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:33.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:34.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:34.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:34.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:34.536+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:35.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:35.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:35.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:35.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:36.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:36.188+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:36.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:36.584+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:37.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:37.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:37.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:37.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:38.197 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:38.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:38.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:38.629+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:39.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:39.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:39.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:39.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:40.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:40.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:40.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:40.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:41.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:41.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:41.686 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:41.684+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:42.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:42.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:42.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:42.721+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:43.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:43.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:43.746 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:43.745+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:44.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:44.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:44.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:44.751+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:45.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:45.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:45.727 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:45.725+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:46.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:46.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:46.723 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:46.721+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:47.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:47.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:47.710 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:47.708+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:48.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:48.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:48.676 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:48.674+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:49.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:49.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:49.705 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:49.703+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:50.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:50.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:50.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:50.707+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:51.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:51.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:51.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:51.742+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:52.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:52.084+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:52.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:52.763+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:53.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:53.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:53.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:53.776+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:54.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:54.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:54.793 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:54.791+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:55.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:55.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:55.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:55.796+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:56.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:56.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:56.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:56.825+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:57.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:57.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:57.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:57.876+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:58.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:58.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:58.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:58.865+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:59.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:53:59.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:53:59.898 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:53:59.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:00.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:00.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:00.870 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:00.868+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:01.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:01.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:01.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:01.864+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:02.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:02.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:02.909 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:02.907+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:03.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:03.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:03.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:03.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:04.145 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:04.144+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:04.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:04.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:05.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:05.140+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:05.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:05.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:06.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:06.091+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:06.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:06.883+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:07.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:07.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:07.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:07.901+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:08.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:08.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:08.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:08.887+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:09.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:09.027+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:09.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:09.900+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:10.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:10.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:10.903 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:10.902+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:11.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:11.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:11.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:11.854+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:12.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:12.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:12.875 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:12.874+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:13.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:13.131+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:13.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:13.907+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:14.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:14.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:14.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:14.909+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:15.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:15.131+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:15.876 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:15.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:16.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:16.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:16.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:16.921+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:17.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:17.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:17.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:17.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:18.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:18.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:18.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:18.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:19.220 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:19.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:20.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:20.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:20.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:20.221+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:21.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:21.015+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:21.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:21.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:21.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:21.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:22.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:22.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:23.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:23.018+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:23.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:23.161+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:23.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:23.977+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:24.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:24.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:24.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:24.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:25.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:25.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:25.965 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:25.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:26.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:26.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:26.986 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:26.984+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:27.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:27.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:27.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:27.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:28.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:28.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:28.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:28.945+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:29.197 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:29.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:29.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:29.994+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:30.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:30.239+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:30.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:30.994+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:31.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:31.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:31.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:31.961+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:32.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:32.229+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:32.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:32.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:33.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:33.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:33.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:33.905+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:34.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:34.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:34.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:34.906+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:35.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:35.140+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:35.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:35.872+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:36.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:36.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:36.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:36.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:37.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:37.204+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:37.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:37.958+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:38.224 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:38.222+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:38.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:38.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:39.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:39.206+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:39.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:39.935+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:40.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:40.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:40.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:40.935+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:41.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:41.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:41.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:41.949+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:42.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:42.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:42.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:42.938+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:43.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:43.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:43.898 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:43.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:44.175 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:44.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:44.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:44.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:45.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:45.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:45.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:45.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:46.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:46.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:46.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:46.980+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:47.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:47.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:47.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:47.971+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:48.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:48.097+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:48.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:48.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:49.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:49.059+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:49.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:49.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:50.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:50.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:50.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:50.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:51.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:51.084+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:51.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:51.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:52.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:52.042+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:52.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:52.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:53.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:53.091+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:53.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:53.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:54.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:54.059+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:54.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:54.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:55.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:55.027+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:55.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:55.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:56.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:56.008+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:56.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:56.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:56.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:56.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:57.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:57.915+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:57.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:57.931+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:58.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:58.895+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:58.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:58.959+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:59.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:54:59.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:54:59.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:54:59.993+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:00.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:00.823+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:00.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:00.961+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:01.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:01.848+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:01.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:01.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:02.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:02.859+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:02.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:02.945+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:03.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:03.860+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:03.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:03.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:04.887 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:04.885+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:04.918 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:04.916+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:05.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:05.872+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:05.931 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:05.929+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:06.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:06.838+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:06.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:06.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:07.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:07.861+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:07.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:07.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:08.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:08.901+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:08.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:08.910+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:09.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:09.891+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:09.905 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:09.903+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:10.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:10.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:10.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:10.914+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:11.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:11.899+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:11.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:11.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:12.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:12.858+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:12.898 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:12.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:13.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:13.854+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:13.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:13.936+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:14.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:14.900+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:14.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:14.944+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:15.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:15.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:15.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:15.981+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:16.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:16.948+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:16.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:16.974+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:17.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:17.996+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:18.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:18.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:19.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:19.017+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:19.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:19.062+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:19.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:19.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:20.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:20.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:21.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:21.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:21.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:21.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:22.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:22.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:22.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:22.139+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:23.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:23.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:23.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:23.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:24.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:24.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:24.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:24.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:25.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:25.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:25.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:25.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:26.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:26.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:26.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:26.103+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:27.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:27.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:27.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:27.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:28.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:28.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:28.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:28.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:29.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:29.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:29.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:29.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:30.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:30.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:30.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:30.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:31.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:31.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:31.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:31.086+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:32.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:32.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:32.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:32.115+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:33.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:33.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:33.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:33.091+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:34.099 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:34.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:34.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:34.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:35.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:35.103+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:35.117 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:35.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:36.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:36.069+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:36.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:36.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:37.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:37.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:37.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:37.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:38.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:38.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:38.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:38.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:39.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:39.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:39.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:39.151+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:40.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:40.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:40.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:40.174+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:41.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:41.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:41.197 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:41.196+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:42.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:42.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:42.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:42.224+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:43.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:43.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:43.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:43.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:44.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:44.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:44.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:44.230+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:45.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:45.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:45.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:45.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:46.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:46.139+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:46.179 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:46.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:47.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:47.124+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:47.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:47.224+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:48.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:48.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:48.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:48.228+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:49.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:49.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:49.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:49.202+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:50.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:50.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:50.244 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:50.242+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:51.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:51.199+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:51.255 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:51.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:52.224 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:52.222+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:52.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:52.222+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:53.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:53.214+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:53.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:53.267+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:54.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:54.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:54.239 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:54.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:55.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:55.218+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:55.260 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:55.258+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:56.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:56.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:56.240 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:56.238+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:57.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:57.198+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:57.223 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:57.221+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:58.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:58.196+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:58.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:58.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:59.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:55:59.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:55:59.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:55:59.250+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:00.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:00.179+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:00.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:00.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:01.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:01.222+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:01.297 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:01.295+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:02.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:02.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:02.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:02.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:03.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:03.249+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:03.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:03.254+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:04.224 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:04.222+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:04.255 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:04.253+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:05.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:05.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:05.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:05.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:06.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:06.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:06.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:06.287+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:07.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:07.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:07.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:07.290+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:08.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:08.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:08.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:08.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:09.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:09.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:09.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:09.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:10.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:10.208+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:10.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:10.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:11.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:11.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:11.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:11.336+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:12.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:12.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:12.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:12.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:13.244 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:13.242+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:13.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:13.336+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:14.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:14.228+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:14.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:14.369+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:15.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:15.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:15.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:15.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:16.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:16.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:16.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:16.299+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:17.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:17.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:17.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:17.329+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:18.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:18.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:18.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:18.283+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:19.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:19.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:19.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:19.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:20.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:20.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:20.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:20.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:21.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:21.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:21.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:21.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:22.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:22.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:22.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:22.247+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:23.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:23.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:23.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:23.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:24.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:24.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:24.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:24.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:25.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:25.126+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:25.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:25.256+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:26.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:26.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:26.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:26.259+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:27.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:27.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:27.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:27.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:28.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:28.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:28.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:28.333+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:29.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:29.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:29.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:29.326+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:30.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:30.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:30.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:30.311+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:31.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:31.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:31.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:31.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:32.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:32.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:32.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:32.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:33.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:33.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:33.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:33.329+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:34.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:34.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:34.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:34.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:35.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:35.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:35.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:35.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:36.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:36.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:36.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:36.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:37.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:37.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:37.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:37.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:38.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:38.042+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:38.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:38.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:38.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:38.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:39.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:39.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:39.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:39.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:40.386 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:40.384+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:40.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:40.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:41.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:41.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:41.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:41.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:42.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:42.434+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:42.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:42.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:43.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:43.422+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:43.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:43.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:44.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:44.415+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:44.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:44.895+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:45.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:45.370+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:45.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:45.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:46.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:46.324+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:46.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:46.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:47.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:47.357+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:47.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:47.828+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:48.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:48.308+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:48.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:48.796+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:49.272 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:49.270+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:49.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:49.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:50.308 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:50.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:50.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:50.792+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:51.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:51.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:51.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:51.810+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:52.396 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:52.394+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:52.829 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:52.828+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:53.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:53.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:53.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:53.830+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:54.383 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:54.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:54.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:54.873+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:55.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:55.367+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:55.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:55.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:56.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:56.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:56.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:56.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:57.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:57.383+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:57.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:57.869+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:58.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:58.378+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:58.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:58.868+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:59.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:56:59.363+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:56:59.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:56:59.904+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:00.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:00.404+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:00.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:00.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:01.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:01.365+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:01.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:01.996+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:02.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:02.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:02.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:02.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:03.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:03.318+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:03.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:03.995+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:04.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:04.289+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:04.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:04.948+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:05.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:05.333+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:05.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:05.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:06.337 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:06.336+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:06.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:06.901+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:07.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:07.375+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:07.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:07.937+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:08.369 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:08.368+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:08.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:08.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:09.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:09.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:09.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:09.950+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:10.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:10.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:10.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:10.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:11.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:11.425+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:11.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:11.908+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:12.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:12.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:12.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:12.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:13.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:13.389+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:13.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:13.901+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:14.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:14.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:14.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:14.900+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:15.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:15.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:15.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:15.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:16.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:16.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:16.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:16.817+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:17.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:17.459+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:17.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:17.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:18.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:18.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:18.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:18.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:19.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:19.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:19.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:19.726+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:20.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:20.561+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:20.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:20.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:21.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:21.538+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:21.707 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:21.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:22.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:22.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:22.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:22.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:23.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:23.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:23.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:23.691+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:24.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:24.536+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:24.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:24.696+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:25.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:25.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:25.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:25.668+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:26.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:26.570+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:26.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:26.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:27.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:27.549+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:27.590 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:27.588+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:28.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:28.550+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:28.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:28.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:29.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:29.548+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:29.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:29.616+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:30.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:30.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:30.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:30.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:31.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:31.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:31.667 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:31.665+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:32.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:32.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:32.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:32.641+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:33.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:33.594+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:33.604 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:33.603+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:34.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:34.600+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:34.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:34.606+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:35.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:35.565+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:35.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:35.616+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:36.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:36.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:36.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:36.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:37.547 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:37.545+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:37.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:37.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:38.552 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:38.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:38.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:38.591+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:39.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:39.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:39.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:39.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:40.567 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:40.565+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:40.651 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:40.650+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:41.617 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:41.615+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:41.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:41.683+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:42.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:42.640+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:42.686 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:42.683+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:43.631 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:43.629+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:43.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:43.658+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:44.630 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:44.630+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:44.649 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:44.648+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:45.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:45.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:45.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:45.698+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:46.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:46.598+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:46.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:46.672+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:47.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:47.621+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:47.711 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:47.710+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:48.616 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:48.615+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:48.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:48.665+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:49.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:49.622+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:49.665 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:49.664+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:50.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:50.622+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:50.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:50.682+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:51.651 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:51.650+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:51.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:51.659+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:52.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:52.647+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:52.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:52.694+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:53.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:53.637+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:53.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:53.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:54.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:54.659+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:54.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:54.682+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:55.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:55.675+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:55.686 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:55.684+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:56.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:56.642+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:56.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:56.698+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:57.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:57.657+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:57.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:57.744+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:58.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:58.627+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:58.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:58.791+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:59.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:57:59.673+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:57:59.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:57:59.837+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:00.721 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:00.719+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:00.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:00.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:01.712 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:01.710+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:01.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:01.892+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:02.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:02.677+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:02.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:02.904+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:03.688 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:03.686+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:03.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:03.878+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:04.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:04.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:04.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:04.878+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:05.755 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:05.753+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:05.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:05.883+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:06.797 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:06.795+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:06.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:06.848+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:07.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:07.797+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:07.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:07.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:08.754 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:08.752+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:08.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:08.855+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:09.790 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:09.788+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:09.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:09.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:10.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:10.756+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:10.854 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:10.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:11.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:11.776+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:11.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:11.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:12.795 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:12.793+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:12.811 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:12.809+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:13.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:13.751+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:13.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:13.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:14.759 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:14.757+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:14.879 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:14.877+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:15.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:15.773+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:15.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:15.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:16.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:16.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:16.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:16.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:17.810 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:17.807+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:17.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:17.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:18.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:18.804+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:18.826 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:18.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:19.813 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:19.811+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:19.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:19.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:20.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:20.855+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:20.859 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:20.857+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:21.885 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:21.883+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:21.905 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:21.903+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:22.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:22.855+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:22.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:22.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:23.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:23.895+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:23.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:23.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:24.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:24.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:24.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:24.940+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:25.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:25.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:25.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:25.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:26.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:26.975+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:27.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:27.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:27.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:27.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:28.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:28.032+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:28.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:28.936+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:28.986 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:28.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:29.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:29.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:30.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:30.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:30.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:30.942+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:31.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:31.028+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:31.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:31.922+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:32.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:32.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:32.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:32.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:32.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:32.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:33.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:33.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:33.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:33.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:34.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:34.944+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:34.975 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:34.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:35.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:35.959+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:35.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:35.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:36.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:36.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:36.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:36.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:37.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:37.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:37.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:37.984+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:38.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:38.957+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:39.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:39.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:39.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:39.974+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:39.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:39.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:40.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:40.930+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:40.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:40.993+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:41.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:41.958+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:41.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:41.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:43.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:43.004+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:43.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:43.011+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:44.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:44.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:44.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:44.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:45.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:45.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:45.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:45.082+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:46.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:46.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:46.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:46.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:47.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:47.065+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:47.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:47.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:48.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:48.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:48.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:48.100+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:49.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:49.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:49.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:49.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:50.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:50.025+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:50.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:50.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:51.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:51.016+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:51.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:51.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:52.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:52.033+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:52.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:52.183+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:53.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:53.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:53.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:53.219+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:54.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:54.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:54.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:54.255+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:55.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:55.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:55.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:55.276+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:56.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:56.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:56.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:56.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:57.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:57.061+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:57.303 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:57.301+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:58.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:58.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:58.285 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:58.283+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:59.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:58:59.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:58:59.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:58:59.333+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:00.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:00.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:00.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:00.339+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:01.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:01.025+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:01.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:01.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:01.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:01.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:02.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:02.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:02.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:02.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:03.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:03.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:03.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:03.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:04.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:04.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:04.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:04.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:05.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:05.434+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:05.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:05.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:06.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:06.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:06.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:06.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:07.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:07.473+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:07.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:07.975+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:08.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:08.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:08.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:08.930+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:09.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:09.498+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:09.975 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:09.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:10.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:10.532+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:10.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:10.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:11.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:11.500+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:11.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:11.928+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:12.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:12.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:12.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:12.924+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:13.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:13.416+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:13.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:13.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:14.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:14.435+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:14.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:14.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:15.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:15.472+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:15.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:15.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:16.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:16.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:16.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:16.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:17.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:17.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:17.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:17.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:18.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:18.476+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:18.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:18.996+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:19.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:19.503+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:20.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:20.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:20.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:20.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:20.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:20.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:21.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:21.542+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:21.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:21.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:22.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:22.572+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:22.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:22.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:23.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:23.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:23.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:23.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:24.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:24.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:24.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:24.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:25.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:25.516+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:26.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:26.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:26.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:26.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:27.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:26.999+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:27.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:27.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:27.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:27.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:28.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:28.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:28.973 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:28.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:29.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:29.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:29.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:29.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:30.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:30.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:30.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:30.931+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:31.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:31.447+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:31.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:31.956+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:32.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:32.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:32.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:32.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:33.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:33.437+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:33.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:33.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:34.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:34.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:35.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:35.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:35.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:35.429+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:35.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:35.989+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:36.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:36.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:36.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:36.995+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:37.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:37.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:38.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:38.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:38.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:38.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:39.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:39.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:39.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:39.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:40.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:40.080+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:40.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:40.471+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:41.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:41.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:41.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:41.520+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:42.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:42.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:42.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:42.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:43.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:43.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:43.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:43.542+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:44.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:44.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:44.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:44.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:45.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:45.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:45.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:45.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:46.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:46.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:46.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:46.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:47.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:47.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:47.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:47.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:48.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:48.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:48.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:48.635+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:49.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:49.128+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:49.650 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:49.648+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:50.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:50.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:50.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:50.640+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:51.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:51.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:51.667 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:51.666+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:52.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:52.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:52.681 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:52.680+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:53.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:53.045+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:53.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:53.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:54.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:54.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:54.654 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:54.653+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:54.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:54.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:55.694 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:55.693+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:56.029 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:56.028+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:56.676 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:56.675+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:57.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:57.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:57.708 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:57.707+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:58.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:58.049+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:58.746 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:58.745+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:59.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T06:59:59.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T06:59:59.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T06:59:59.738+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:00.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:00.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:00.774 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:00.773+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:01.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:01.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:01.747 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:01.746+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:02.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:02.067+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:02.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:02.790+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:03.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:03.084+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:03.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:03.834+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:04.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:04.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:04.841 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:04.839+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:05.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:05.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:05.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:05.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:06.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:06.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:06.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:06.830+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:07.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:07.116+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:07.852 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:07.850+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:08.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:08.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:08.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:08.820+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:09.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:09.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:09.795 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:09.793+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:10.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:10.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:10.828 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:10.826+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:11.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:11.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:11.864 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:11.862+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:12.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:12.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:12.818 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:12.816+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:13.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:13.089+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:13.859 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:13.857+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:14.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:14.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:14.873 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:14.872+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:15.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:15.084+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:15.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:15.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:16.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:16.068+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:16.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:16.922+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:17.053 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:17.052+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:17.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:17.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:18.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:18.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:18.921 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:18.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:19.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:19.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:19.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:19.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:20.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:20.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:20.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:20.949+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:21.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:21.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:21.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:21.994+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:22.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:22.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:22.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:22.970+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:23.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:23.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:23.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:23.940+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:24.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:24.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:24.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:24.977+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:25.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:25.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:26.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:26.022+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:26.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:26.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:27.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:27.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:27.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:27.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:28.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:28.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:28.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:28.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:29.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:29.054+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:29.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:29.152+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:30.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:30.089+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:30.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:30.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:31.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:31.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:31.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:31.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:32.120 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:32.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:32.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:32.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:33.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:33.165+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:33.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:33.173+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:34.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:34.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:34.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:34.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:35.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:35.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:35.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:35.170+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:36.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:36.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:36.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:36.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:37.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:37.097+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:37.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:37.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:38.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:38.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:38.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:38.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:39.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:39.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:39.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:39.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:40.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:40.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:40.099 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:40.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:41.064 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:41.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:41.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:41.086+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:42.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:42.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:42.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:42.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:43.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:43.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:43.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:43.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:44.016 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:44.015+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:44.140 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:44.139+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:45.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:45.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:45.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:45.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:46.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:46.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:46.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:46.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:47.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:47.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:47.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:47.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:48.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:48.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:48.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:48.095+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:49.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:49.045+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:49.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:49.140+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:50.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:50.032+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:50.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:50.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:51.000 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:50.998+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:51.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:51.148+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:51.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:51.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:52.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:52.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:52.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:52.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:53.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:53.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:53.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:53.969+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:54.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:54.139+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:54.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:54.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:55.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:55.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:56.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:56.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:56.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:56.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:56.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:56.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:57.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:57.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:57.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:57.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:58.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:58.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:58.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:58.938+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:59.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:00:59.125+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:00:59.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:00:59.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:00.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:00.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:00.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:00.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:01.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:01.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:01.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:01.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:02.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:02.126+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:02.987 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:02.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:03.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:03.099+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:03.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:03.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:04.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:04.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:04.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:04.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:05.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:05.078+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:05.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:05.951+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:06.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:06.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:06.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:06.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:07.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:07.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:07.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:07.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:08.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:08.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:09.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:09.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:09.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:09.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:10.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:10.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:10.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:10.189+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:11.042 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:11.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:11.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:11.172+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:11.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:11.995+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:12.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:12.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:12.973 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:12.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:13.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:13.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:13.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:13.928+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:14.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:14.146+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:14.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:14.915+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:15.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:15.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:15.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:15.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:16.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:16.150+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:16.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:16.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:17.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:17.185+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:17.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:17.826+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:18.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:18.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:18.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:18.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:19.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:19.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:19.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:19.889+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:20.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:20.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:20.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:20.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:21.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:21.140+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:21.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:21.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:22.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:22.146+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:22.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:22.918+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:23.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:23.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:23.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:23.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:24.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:24.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:24.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:24.913+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:25.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:25.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:25.952 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:25.951+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:26.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:26.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:26.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:26.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:27.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:27.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:27.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:27.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:28.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:28.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:28.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:28.973+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:29.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:29.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:29.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:29.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:30.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:30.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:30.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:30.961+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:31.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:31.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:31.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:31.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:32.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:32.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:33.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:33.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:33.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:33.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:34.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:34.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:34.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:34.103+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:35.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:35.033+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:35.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:35.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:36.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:36.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:36.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:36.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:36.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:36.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:37.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:37.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:38.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:38.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:38.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:38.067+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:38.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:38.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:39.099 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:39.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:39.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:39.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:40.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:40.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:40.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:40.924+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:41.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:41.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:41.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:41.967+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:42.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:42.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:42.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:42.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:43.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:43.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:43.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:43.879+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:44.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:44.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:44.895 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:44.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:45.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:45.066+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:45.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:45.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:46.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:46.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:46.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:46.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:47.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:47.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:47.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:47.915+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:48.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:48.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:48.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:48.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:48.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:48.995+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:49.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:49.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:49.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:49.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:50.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:50.906+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:50.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:50.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:51.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:51.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:51.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:51.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:52.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:52.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:52.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:52.892+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:53.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:53.858+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:53.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:53.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:54.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:54.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:54.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:54.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:55.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:55.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:55.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:55.911+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:56.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:56.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:56.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:56.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:57.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:57.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:57.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:57.911+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:58.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:58.825+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:58.917 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:58.915+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:59.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:01:59.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:01:59.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:01:59.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:00.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:00.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:00.898 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:00.897+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:01.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:01.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:01.873 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:01.872+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:02.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:02.733+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:02.849 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:02.848+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:03.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:03.750+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:03.828 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:03.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:04.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:04.757+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:04.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:04.857+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:05.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:05.767+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:05.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:05.884+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:06.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:06.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:06.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:06.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:07.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:07.836+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:07.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:07.936+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:08.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:08.808+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:08.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:08.921+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:09.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:09.836+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:09.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:09.959+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:10.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:10.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:10.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:10.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:11.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:11.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:12.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:12.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:12.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:12.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:13.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:13.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:13.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:13.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:14.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:14.020+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:14.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:14.782+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:15.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:15.047+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:15.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:15.791+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:16.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:16.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:16.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:16.783+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:17.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:17.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:17.740 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:17.738+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:18.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:18.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:18.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:18.700+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:19.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:19.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:19.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:19.660+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:20.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:20.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:20.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:20.630+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:21.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:21.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:21.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:21.635+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:22.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:22.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:22.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:22.662+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:23.099 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:23.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:23.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:23.712+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:24.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:24.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:24.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:24.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:25.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:25.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:25.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:25.798+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:26.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:26.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:26.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:26.819+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:27.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:27.054+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:27.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:27.772+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:28.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:28.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:28.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:28.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:29.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:29.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:29.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:29.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:30.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:30.030+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:30.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:30.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:30.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:30.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:31.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:31.704+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:31.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:31.976+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:32.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:32.695+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:33.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:33.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:33.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:33.687+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:34.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:34.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:34.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:34.730+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:35.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:35.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:35.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:35.774+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:36.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:36.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:36.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:36.762+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:37.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:37.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:37.760 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:37.758+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:38.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:38.082+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:38.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:38.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:39.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:39.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:39.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:39.710+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:40.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:40.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:40.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:40.735+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:41.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:41.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:41.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:41.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:42.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:42.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:42.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:42.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:43.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:43.129+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:43.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:43.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:44.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:44.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:44.783 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:44.782+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:45.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:45.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:45.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:45.773+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:46.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:46.151+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:46.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:46.736+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:47.152 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:47.151+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:47.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:47.735+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:48.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:48.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:48.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:48.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:49.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:49.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:49.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:49.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:50.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:50.149+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:50.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:50.783+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:51.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:51.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:51.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:51.815+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:52.159 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:52.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:52.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:52.781+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:53.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:53.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:53.815 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:53.813+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:54.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:54.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:54.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:54.808+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:55.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:55.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:55.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:55.829+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:56.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:56.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:56.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:56.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:56.986 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:56.984+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:57.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:57.791+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:57.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:57.974+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:58.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:58.823+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:58.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:02:58.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:02:59.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:02:59.774+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:00.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:00.001+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:00.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:00.783+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:00.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:00.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:01.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:01.786+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:01.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:01.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:02.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:02.830+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:03.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:03.008+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:03.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:03.819+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:03.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:03.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:04.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:04.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:05.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:05.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:05.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:05.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:05.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:05.995+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:06.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:06.807+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:06.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:06.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:07.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:07.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:07.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:07.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:08.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:08.835+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:09.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:09.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:09.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:09.843+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:10.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:10.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:10.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:10.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:10.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:10.970+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:11.815 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:11.813+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:11.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:11.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:12.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:12.810+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:12.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:12.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:13.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:13.858+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:13.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:13.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:14.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:14.903+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:14.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:14.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:15.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:15.905+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:15.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:15.972+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:16.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:16.932+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:16.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:16.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:17.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:17.948+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:17.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:17.972+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:18.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:18.921+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:19.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:19.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:19.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:19.898+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:19.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:19.967+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:20.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:20.890+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:21.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:21.010+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:21.865 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:21.862+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:22.061 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:22.059+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:22.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:22.894+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:23.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:23.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:23.854 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:23.852+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:24.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:24.061+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:24.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:24.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:25.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:25.017+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:25.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:25.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:26.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:26.033+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:26.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:26.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:26.987 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:26.986+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:27.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:27.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:27.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:27.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:28.910 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:28.909+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:28.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:28.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:29.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:29.905+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:29.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:29.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:30.887 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:30.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:30.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:30.899+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:31.876 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:31.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:31.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:31.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:32.845 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:32.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:32.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:32.895+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:33.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:33.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:33.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:33.911+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:34.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:34.822+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:34.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:34.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:35.829 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:35.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:35.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:35.891+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:36.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:36.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:36.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:36.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:37.821 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:37.819+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:37.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:37.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:38.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:38.806+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:38.838 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:38.836+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:39.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:39.773+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:39.865 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:39.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:40.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:40.767+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:40.851 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:40.849+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:41.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:41.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:41.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:41.891+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:42.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:42.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:42.931 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:42.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:43.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:43.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:43.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:43.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:44.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:44.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:44.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:44.925+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:45.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:45.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:45.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:45.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:46.820 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:46.818+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:46.917 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:46.915+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:47.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:47.829+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:47.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:47.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:48.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:48.823+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:48.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:48.967+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:49.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:49.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:49.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:49.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:50.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:50.854+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:50.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:50.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:51.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:51.881+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:52.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:52.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:52.877 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:52.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:53.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:53.016+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:53.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:53.878+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:54.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:54.020+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:54.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:54.926+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:54.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:54.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:55.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:55.959+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:55.969 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:55.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:56.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:56.940+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:56.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:56.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:57.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:57.979+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:57.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:57.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:58.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:58.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:59.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:59.018+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:59.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:03:59.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:03:59.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:03:59.974+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:00.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:00.925+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:00.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:00.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:01.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:01.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:02.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:02.008+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:02.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:02.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:02.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:02.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:03.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:03.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:03.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:03.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:04.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:04.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:04.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:04.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:05.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:05.961+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:05.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:05.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:06.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:06.957+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:07.003 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:07.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:07.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:07.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:07.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:07.993+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:08.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:08.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:09.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:09.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:09.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:09.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:10.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:10.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:10.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:10.938+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:11.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:11.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:11.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:11.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:12.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:12.062+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:13.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:13.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:13.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:13.041+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:13.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:13.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:14.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:14.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:14.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:14.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:14.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:14.993+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:15.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:15.937+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:16.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:16.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:16.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:16.911+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:17.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:17.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:17.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:17.900+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:18.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:18.089+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:18.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:18.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:19.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:19.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:19.907 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:19.905+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:20.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:20.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:20.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:20.921+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:20.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:20.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:21.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:21.903+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:21.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:21.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:22.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:22.894+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:22.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:22.932+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:23.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:23.904+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:23.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:23.936+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:24.879 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:24.877+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:24.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:24.942+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:25.903 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:25.901+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:25.970 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:25.968+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:26.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:26.860+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:27.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:27.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:27.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:27.843+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:28.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:28.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:28.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:28.806+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:29.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:29.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:29.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:29.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:30.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:30.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:30.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:30.774+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:31.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:31.122+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:31.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:31.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:32.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:32.168+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:32.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:32.745+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:33.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:33.185+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:33.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:33.749+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:34.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:34.183+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:34.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:34.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:35.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:35.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:35.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:35.720+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:36.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:36.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:36.739 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:36.737+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:37.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:37.115+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:37.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:37.749+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:38.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:38.119+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:38.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:38.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:39.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:39.170+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:39.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:39.671+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:40.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:40.140+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:40.688 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:40.686+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:41.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:41.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:41.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:41.683+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:42.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:42.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:42.652 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:42.650+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:43.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:43.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:43.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:43.696+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:44.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:44.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:44.724 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:44.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:45.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:45.129+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:45.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:45.683+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:46.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:46.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:46.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:46.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:47.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:47.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:47.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:47.731+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:48.141 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:48.139+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:48.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:48.732+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:49.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:49.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:49.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:49.766+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:50.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:50.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:50.817 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:50.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:51.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:51.115+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:51.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:51.826+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:52.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:52.138+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:52.820 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:52.819+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:53.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:53.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:53.815 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:53.814+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:54.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:54.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:54.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:54.795+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:55.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:55.146+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:55.817 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:55.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:56.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:56.138+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:56.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:56.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:57.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:57.184+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:57.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:57.877+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:58.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:58.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:58.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:58.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:59.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:04:59.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:04:59.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:04:59.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:00.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:00.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:00.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:00.860+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:01.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:01.122+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:01.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:01.910+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:02.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:02.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:02.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:02.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:03.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:03.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:03.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:03.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:04.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:04.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:04.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:04.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:05.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:05.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:05.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:05.936+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:06.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:06.030+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:06.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:06.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:07.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:07.015+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:07.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:07.965+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:08.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:08.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:08.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:08.922+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:09.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:09.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:09.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:09.928+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:10.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:10.067+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:10.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:10.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:11.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:11.089+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:11.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:11.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:12.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:12.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:12.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:12.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:13.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:13.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:13.997 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:13.995+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:14.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:14.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:15.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:15.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:15.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:15.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:16.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:16.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:16.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:16.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:16.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:16.986+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:17.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:17.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:17.957 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:17.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:18.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:18.052+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:18.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:18.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:19.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:19.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:20.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:20.004+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:20.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:20.082+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:20.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:20.975+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:21.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:21.069+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:21.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:21.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:22.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:22.023+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:22.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:22.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:23.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:23.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:23.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:23.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:24.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:24.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:25.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:24.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:25.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:25.099+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:25.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:25.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:26.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:26.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:26.975 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:26.972+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:27.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:27.082+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:27.991 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:27.989+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:28.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:28.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:29.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:29.009+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:29.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:29.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:29.976 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:29.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:30.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:30.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:31.013 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:31.011+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:31.019 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:31.017+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:32.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:32.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:32.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:32.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:32.982 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:32.981+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:33.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:33.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:34.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:34.017+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:34.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:34.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:34.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:34.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:35.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:35.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:35.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:35.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:36.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:36.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:36.909 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:36.908+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:37.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:37.258+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:37.879 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:37.878+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:38.285 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:38.284+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:38.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:38.892+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:39.274 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:39.272+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:39.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:39.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:40.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:40.272+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:40.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:40.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:41.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:41.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:41.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:41.892+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:42.286 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:42.285+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:42.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:42.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:43.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:43.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:43.872 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:43.870+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:44.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:44.285+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:44.905 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:44.903+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:45.317 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:45.315+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:45.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:45.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:46.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:46.281+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:46.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:46.923+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:47.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:47.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:47.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:47.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:48.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:48.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:48.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:48.925+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:49.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:49.234+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:49.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:49.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:50.197 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:50.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:50.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:50.956+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:51.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:51.158+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:51.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:51.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:52.171 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:52.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:52.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:52.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:53.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:53.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:54.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:54.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:54.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:54.175+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:55.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:55.016+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:55.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:55.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:56.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:56.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:56.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:56.250+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:57.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:57.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:57.269 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:57.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:58.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:58.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:58.286 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:58.284+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:58.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:05:58.992+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:05:59.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:05:59.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:00.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:00.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:00.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:00.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:01.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:01.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:01.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:01.228+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:02.066 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:02.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:02.238 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:02.236+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:03.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:03.079+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:03.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:03.190+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:04.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:04.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:04.178 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:04.175+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:05.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:05.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:05.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:05.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:06.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:06.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:06.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:06.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:07.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:07.055+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:07.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:07.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:08.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:08.047+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:08.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:08.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:09.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:09.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:09.220 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:09.218+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:10.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:10.117+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:10.232 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:10.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:11.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:11.079+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:11.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:11.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:12.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:12.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:12.270 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:12.267+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:13.091 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:13.089+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:13.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:13.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:14.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:14.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:14.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:14.256+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:15.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:15.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:15.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:15.211+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:16.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:16.033+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:16.240 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:16.239+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:17.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:17.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:17.258 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:17.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:18.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:18.015+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:18.304 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:18.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:19.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:19.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:19.303 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:19.302+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:20.084 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:20.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:20.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:20.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:21.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:21.131+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:21.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:21.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:22.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:22.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:22.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:22.264+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:23.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:23.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:23.292 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:23.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:24.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:24.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:24.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:24.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:25.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:25.108+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:25.271 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:25.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:26.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:26.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:26.271 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:26.269+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:27.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:27.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:27.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:27.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:28.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:28.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:28.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:28.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:29.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:29.048+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:29.290 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:29.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:30.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:30.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:30.312 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:30.310+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:31.082 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:31.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:31.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:31.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:32.089 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:32.086+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:32.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:32.338+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:33.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:33.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:33.346 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:33.344+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:34.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:34.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:34.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:34.308+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:35.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:35.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:35.335 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:35.332+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:36.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:36.045+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:36.385 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:36.383+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:37.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:37.065+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:37.339 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:37.337+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:38.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:38.031+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:38.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:38.349+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:39.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:39.047+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:39.342 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:39.340+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:40.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:40.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:40.330 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:40.327+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:41.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:41.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:41.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:41.364+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:42.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:42.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:42.416 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:42.414+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:43.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:43.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:43.464 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:43.462+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:44.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:44.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:44.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:44.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:45.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:45.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:45.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:45.402+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:46.086 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:46.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:46.422 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:46.419+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:47.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:47.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:47.468 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:47.466+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:48.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:48.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:48.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:48.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:49.087 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:49.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:49.437 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:49.435+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:50.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:50.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:50.439 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:50.437+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:51.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:51.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:51.444 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:51.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:52.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:52.122+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:52.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:52.460+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:53.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:53.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:53.416 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:53.414+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:54.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:54.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:54.460 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:54.457+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:55.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:55.028+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:55.425 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:55.424+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:56.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:56.054+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:56.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:56.451+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:57.027 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:57.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:57.429 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:57.428+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:58.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:58.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:58.387 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:58.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:59.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:06:59.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:06:59.349 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:06:59.348+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:00.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:00.054+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:00.302 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:00.301+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:01.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:01.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:01.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:01.267+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:02.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:02.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:02.290 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:02.288+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:03.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:03.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:03.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:03.245+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:04.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:04.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:04.279 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:04.278+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:05.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:05.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:05.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:05.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:06.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:06.153+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:06.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:06.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:07.191 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:07.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:07.318 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:07.317+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:08.172 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:08.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:08.313 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:08.312+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:09.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:09.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:09.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:09.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:10.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:10.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:10.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:10.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:11.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:11.103+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:11.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:11.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:12.151 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:12.149+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:12.215 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:12.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:13.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:13.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:13.225 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:13.223+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:14.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:14.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:14.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:14.224+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:15.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:15.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:15.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:15.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:16.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:16.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:16.264 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:16.262+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:17.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:17.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:17.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:17.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:18.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:18.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:18.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:18.239+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:19.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:19.086+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:19.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:19.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:20.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:20.078+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:20.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:20.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:21.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:21.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:21.306 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:21.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:22.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:22.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:22.337 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:22.335+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:23.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:23.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:23.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:23.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:24.069 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:24.067+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:24.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:24.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:25.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:25.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:25.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:25.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:26.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:26.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:26.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:26.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:27.013 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:27.011+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:27.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:27.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:28.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:28.062+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:28.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:28.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:29.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:29.022+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:29.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:29.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:30.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:30.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:30.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:30.211+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:31.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:31.021+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:31.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:31.234+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:32.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:32.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:32.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:32.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:33.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:33.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:33.201 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:33.199+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:34.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:34.077+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:34.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:34.232+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:35.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:35.065+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:35.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:35.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:36.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:36.048+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:36.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:36.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:37.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:37.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:37.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:37.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:38.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:38.122+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:38.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:38.209+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:39.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:39.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:39.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:39.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:40.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:40.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:40.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:40.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:41.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:41.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:41.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:41.234+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:42.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:42.067+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:42.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:42.272+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:43.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:43.068+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:43.296 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:43.295+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:44.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:44.084+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:44.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:44.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:45.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:45.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:45.269 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:45.268+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:46.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:46.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:46.251 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:46.250+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:47.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:47.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:47.274 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:47.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:48.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:48.033+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:48.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:48.262+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:49.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:49.076+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:49.274 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:49.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:50.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:50.027+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:50.322 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:50.321+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:51.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:51.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:51.372 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:51.371+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:52.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:52.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:52.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:52.330+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:53.061 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:53.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:53.306 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:53.304+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:54.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:54.012+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:54.345 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:54.343+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:54.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:54.987+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:55.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:55.351+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:56.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:56.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:56.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:56.359+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:57.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:57.022+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:57.341 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:57.339+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:57.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:57.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:58.355 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:58.353+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:59.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:59.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:59.388 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:07:59.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:07:59.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:07:59.958+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:00.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:00.394+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:00.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:00.975+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:01.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:01.401+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:01.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:01.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:02.431 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:02.429+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:02.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:02.972+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:03.440 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:03.437+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:03.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:03.930+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:04.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:04.391+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:04.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:04.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:05.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:05.396+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:05.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:05.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:06.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:06.403+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:06.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:06.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:07.362 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:07.360+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:07.879 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:07.877+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:08.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:08.387+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:08.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:08.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:09.406 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:09.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:09.873 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:09.871+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:10.415 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:10.413+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:10.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:10.905+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:11.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:11.417+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:11.887 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:11.885+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:12.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:12.426+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:12.865 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:12.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:13.421 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:13.419+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:13.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:13.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:14.457 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:14.455+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:14.836 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:14.834+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:15.423 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:15.421+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:15.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:15.883+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:16.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:16.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:16.868 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:16.866+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:17.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:17.411+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:17.847 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:17.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:18.407 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:18.405+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:18.829 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:18.827+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:19.369 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:19.367+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:19.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:19.831+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:20.357 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:20.355+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:20.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:20.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:21.377 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:21.374+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:21.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:21.839+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:22.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:22.400+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:22.852 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:22.851+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:23.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:23.392+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:23.821 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:23.820+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:24.376 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:24.372+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:24.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:24.797+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:25.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:25.335+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:25.786 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:25.784+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:26.354 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:26.353+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:26.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:26.759+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:27.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:27.363+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:27.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:27.769+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:28.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:28.352+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:28.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:28.743+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:29.343 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:29.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:29.699 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:29.698+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:30.372 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:30.370+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:30.718 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:30.717+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:31.351 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:31.350+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:31.746 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:31.745+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:32.387 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:32.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:32.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:32.743+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:33.390 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:33.388+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:33.773 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:33.771+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:34.383 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:34.381+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:34.792 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:34.789+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:35.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:35.337+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:35.818 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:35.816+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:36.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:36.290+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:36.796 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:36.794+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:37.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:37.329+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:37.814 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:37.811+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:38.291 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:38.288+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:38.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:38.773+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:39.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:39.297+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:39.786 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:39.784+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:40.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:40.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:40.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:40.741+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:41.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:41.229+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:41.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:41.789+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:42.260 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:42.257+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:42.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:42.767+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:43.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:43.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:43.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:43.722+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:44.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:44.188+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:44.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:44.746+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:45.199 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:45.197+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:45.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:45.760+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:46.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:46.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:46.796 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:46.794+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:47.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:47.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:47.825 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:47.823+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:48.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:48.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:48.850 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:48.847+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:49.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:49.155+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:49.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:49.885+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:50.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:50.152+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:50.868 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:50.866+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:51.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:51.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:51.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:51.888+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:52.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:52.145+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:52.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:52.883+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:53.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:53.179+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:53.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:53.888+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:54.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:54.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:54.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:54.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:55.184 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:55.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:55.841 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:55.839+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:56.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:56.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:56.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:56.805+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:57.179 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:57.177+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:57.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:57.777+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:58.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:58.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:58.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:58.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:59.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:08:59.225+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:08:59.811 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:08:59.809+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:00.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:00.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:00.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:00.829+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:01.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:01.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:01.839 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:01.837+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:02.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:02.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:02.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:02.837+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:03.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:03.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:03.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:03.804+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:04.207 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:04.205+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:04.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:04.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:05.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:05.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:05.776 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:05.775+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:06.203 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:06.202+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:06.755 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:06.754+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:07.201 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:07.199+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:07.763 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:07.762+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:08.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:08.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:08.726 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:08.724+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:09.171 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:09.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:09.752 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:09.750+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:10.137 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:10.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:10.751 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:10.750+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:11.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:11.092+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:11.797 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:11.796+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:12.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:12.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:12.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:12.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:13.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:13.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:13.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:13.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:14.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:14.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:14.853 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:14.852+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:15.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:15.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:15.837 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:15.836+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:16.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:16.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:16.825 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:16.823+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:17.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:17.092+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:17.812 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:17.810+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:18.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:18.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:18.860 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:18.857+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:19.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:19.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:19.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:19.813+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:20.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:20.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:20.865 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:20.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:21.078 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:21.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:21.840 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:21.838+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:22.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:22.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:22.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:22.846+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:23.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:23.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:23.839 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:23.836+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:24.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:24.077+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:24.801 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:24.799+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:25.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:25.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:25.845 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:25.843+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:26.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:26.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:26.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:26.864+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:27.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:27.057+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:27.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:27.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:28.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:28.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:28.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:28.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:29.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:29.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:29.889 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:29.887+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:30.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:30.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:30.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:30.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:31.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:31.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:31.858 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:31.856+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:32.019 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:32.016+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:32.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:32.864+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:33.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:33.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:33.841 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:33.839+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:34.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:34.015+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:34.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:34.860+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:35.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:35.042+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:35.903 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:35.901+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:36.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:36.089+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:36.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:36.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:37.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:37.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:37.863 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:37.861+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:38.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:38.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:38.859 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:38.857+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:39.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:39.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:39.874 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:39.871+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:40.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:40.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:40.876 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:40.874+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:41.149 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:41.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:41.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:41.909+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:42.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:42.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:42.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:42.950+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:43.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:43.115+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:43.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:43.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:44.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:44.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:44.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:44.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:45.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:45.134+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:45.965 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:45.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:46.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:46.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:46.917 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:46.915+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:47.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:47.121+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:47.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:47.949+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:48.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:48.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:48.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:48.911+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:49.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:49.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:49.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:49.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:50.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:50.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:50.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:50.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:51.152 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:51.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:51.913 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:51.912+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:52.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:52.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:52.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:52.884+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:53.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:53.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:53.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:53.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:54.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:54.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:54.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:54.940+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:55.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:55.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:55.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:55.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:56.060 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:56.059+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:56.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:56.898+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:57.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:57.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:57.909 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:57.908+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:58.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:58.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:58.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:58.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:59.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:09:59.131+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:09:59.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:09:59.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:00.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:00.098+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:00.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:00.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:01.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:01.145+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:01.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:01.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:02.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:02.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:03.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:03.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:03.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:03.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:03.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:03.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:04.203 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:04.201+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:05.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:05.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:05.178 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:05.176+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:06.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:06.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:06.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:06.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:06.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:06.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:07.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:07.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:08.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:08.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:08.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:08.208+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:09.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:09.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:09.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:09.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:09.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:09.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:10.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:10.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:10.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:10.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:11.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:11.152+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:11.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:11.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:12.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:12.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:12.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:12.961+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:13.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:13.155+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:13.972 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:13.970+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:14.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:14.128+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:15.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:15.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:15.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:15.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:15.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:15.982+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:16.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:16.034+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:16.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:16.942+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:17.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:17.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:17.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:17.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:18.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:18.010+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:18.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:18.914+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:18.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:18.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:19.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:19.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:19.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:19.945+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:20.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:20.906+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:20.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:20.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:21.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:21.891+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:21.934 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:21.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:22.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:22.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:22.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:22.940+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:23.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:23.892+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:23.925 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:23.923+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:24.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:24.848+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:24.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:24.891+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:25.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:25.832+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:25.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:25.892+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:26.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:26.882+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:26.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:26.912+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:27.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:27.852+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:27.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:27.943+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:28.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:28.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:28.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:28.957+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:29.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:29.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:29.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:29.932+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:30.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:30.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:30.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:30.956+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:31.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:31.860+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:32.005 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:32.003+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:32.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:32.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:33.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:33.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:33.874 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:33.873+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:33.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:33.994+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:34.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:34.885+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:34.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:34.958+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:35.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:35.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:36.008 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:36.006+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:36.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:36.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:37.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:37.010+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:37.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:37.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:38.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:38.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:38.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:38.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:39.030 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:39.029+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:39.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:39.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:39.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:39.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:40.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:40.989+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:40.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:40.992+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:41.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:41.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:42.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:42.000+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:42.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:42.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:43.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:43.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:43.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:43.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:44.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:44.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:44.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:44.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:45.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:45.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:45.918 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:45.916+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:46.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:46.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:46.926 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:46.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:47.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:47.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:47.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:47.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:48.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:48.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:48.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:48.884+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:49.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:49.121+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:49.852 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:49.850+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:50.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:50.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:50.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:50.898+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:51.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:51.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:51.868 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:51.866+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:52.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:52.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:52.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:52.894+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:53.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:53.092+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:53.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:53.912+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:54.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:54.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:54.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:54.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:55.111 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:55.109+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:55.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:55.910+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:56.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:56.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:56.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:56.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:57.104 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:57.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:57.898 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:57.896+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:58.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:58.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:58.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:58.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:59.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:10:59.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:10:59.892 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:10:59.890+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:00.149 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:00.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:00.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:00.853+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:01.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:01.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:01.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:01.813+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:02.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:02.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:02.800 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:02.798+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:03.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:03.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:03.788 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:03.786+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:04.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:04.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:04.835 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:04.833+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:05.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:05.131+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:05.826 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:05.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:06.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:06.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:06.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:06.864+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:07.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:07.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:07.873 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:07.871+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:08.255 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:08.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:08.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:08.906+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:09.274 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:09.272+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:09.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:09.932+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:10.267 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:10.265+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:10.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:10.895+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:11.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:11.264+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:11.905 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:11.903+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:12.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:12.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:12.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:12.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:13.294 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:13.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:13.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:13.976+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:14.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:14.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:14.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:14.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:15.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:15.229+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:15.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:15.970+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:16.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:16.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:16.931 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:16.930+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:17.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:17.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:17.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:17.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:18.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:18.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:18.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:18.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:19.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:19.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:19.915 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:19.914+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:20.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:20.126+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:20.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:20.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:21.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:21.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:21.850 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:21.848+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:22.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:22.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:22.837 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:22.836+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:23.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:23.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:23.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:23.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:24.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:24.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:24.781 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:24.780+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:25.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:25.179+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:25.819 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:25.817+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:26.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:26.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:26.867 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:26.865+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:27.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:27.184+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:27.915 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:27.913+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:28.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:28.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:28.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:28.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:29.176 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:29.174+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:29.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:29.935+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:30.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:30.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:30.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:30.925+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:31.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:31.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:31.921 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:31.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:32.157 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:32.155+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:32.892 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:32.890+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:33.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:33.152+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:33.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:33.938+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:34.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:34.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:34.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:34.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:35.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:35.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:35.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:35.988+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:36.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:36.179+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:37.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:37.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:37.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:37.163+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:38.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:38.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:38.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:38.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:39.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:39.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:39.236 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:39.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:40.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:40.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:40.255 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:40.250+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:40.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:40.969+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:41.303 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:41.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:41.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:41.988+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:42.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:42.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:43.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:43.034+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:43.291 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:43.288+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:43.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:43.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:44.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:44.241+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:44.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:44.944+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:45.287 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:45.285+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:45.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:45.951+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:46.302 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:46.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:46.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:46.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:47.295 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:47.293+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:47.985 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:47.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:48.315 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:48.313+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:48.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:48.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:49.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:49.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:49.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:49.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:50.306 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:50.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:50.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:50.959+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:51.337 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:51.335+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:51.923 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:51.921+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:52.321 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:52.319+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:52.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:52.930+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:53.335 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:53.333+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:53.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:53.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:54.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:54.321+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:54.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:54.906+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:55.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:55.275+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:55.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:55.934+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:56.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:56.288+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:56.948 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:56.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:57.316 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:57.315+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:57.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:57.921+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:58.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:58.345+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:58.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:58.911+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:59.318 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:11:59.317+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:11:59.875 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:11:59.874+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:00.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:00.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:00.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:00.911+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:01.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:01.299+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:01.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:01.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:02.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:02.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:02.936 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:02.935+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:03.312 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:03.310+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:03.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:03.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:04.341 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:04.339+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:04.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:04.910+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:05.371 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:05.370+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:05.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:05.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:06.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:06.363+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:06.951 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:06.949+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:07.381 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:07.380+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:07.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:07.974+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:08.357 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:08.355+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:08.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:08.948+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:09.367 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:09.365+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:09.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:09.930+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:10.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:10.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:10.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:10.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:11.381 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:11.379+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:11.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:11.933+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:12.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:12.359+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:12.986 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:12.983+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:13.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:13.389+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:13.943 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:13.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:14.422 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:14.420+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:14.984 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:14.982+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:15.437 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:15.435+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:16.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:16.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:16.475 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:16.473+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:17.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:17.020+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:17.496 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:17.494+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:18.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:18.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:18.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:18.491+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:19.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:19.006+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:19.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:19.508+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:20.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:20.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:20.470 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:20.468+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:21.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:21.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:21.438 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:21.436+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:22.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:22.004+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:22.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:22.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:23.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:22.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:23.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:23.417+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:23.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:23.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:24.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:24.402+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:24.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:24.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:25.382 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:25.380+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:25.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:25.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:26.352 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:26.350+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:26.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:26.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:27.323 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:27.321+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:27.999 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:27.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:28.342 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:28.340+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:28.976 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:28.973+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:29.365 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:29.363+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:29.942 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:29.940+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:30.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:30.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:30.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:30.944+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:31.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:31.389+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:31.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:31.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:32.360 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:32.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:32.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:32.938+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:33.330 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:33.328+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:33.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:33.943+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:34.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:34.305+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:34.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:34.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:35.346 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:35.344+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:35.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:35.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:36.313 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:36.311+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:36.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:36.950+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:37.306 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:37.303+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:37.904 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:37.902+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:38.307 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:38.304+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:38.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:38.878+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:39.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:39.283+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:39.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:39.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:40.322 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:40.320+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:40.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:40.894+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:41.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:41.349+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:41.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:41.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:42.363 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:42.362+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:42.979 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:42.978+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:43.324 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:43.323+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:44.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:44.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:44.320 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:44.318+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:45.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:45.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:45.324 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:45.323+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:46.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:46.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:46.279 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:46.278+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:47.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:47.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:47.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:47.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:48.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:48.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:48.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:48.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:49.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:49.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:49.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:49.258+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:50.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:50.082+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:50.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:50.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:51.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:51.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:51.280 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:51.277+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:52.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:52.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:52.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:52.264+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:53.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:53.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:53.245 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:53.243+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:54.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:54.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:54.289 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:54.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:55.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:55.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:55.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:55.245+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:56.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:56.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:56.229 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:56.227+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:57.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:57.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:57.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:57.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:58.066 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:58.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:58.201 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:58.199+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:59.054 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:12:59.051+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:12:59.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:12:59.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:00.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:00.068+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:00.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:00.140+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:01.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:01.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:01.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:01.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:02.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:02.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:02.211 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:02.209+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:03.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:03.127+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:03.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:03.185+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:04.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:04.135+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:04.238 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:04.236+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:05.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:05.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:05.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:05.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:06.163 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:06.161+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:06.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:06.245+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:07.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:07.125+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:07.239 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:07.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:08.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:08.110+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:08.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:08.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:09.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:09.140+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:09.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:09.229+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:10.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:10.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:10.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:10.219+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:11.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:11.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:11.239 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:11.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:12.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:12.159+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:12.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:12.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:13.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:13.177+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:13.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:13.228+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:14.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:14.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:14.239 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:14.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:15.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:15.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:15.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:15.241+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:16.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:16.156+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:16.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:16.226+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:17.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:17.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:17.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:17.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:18.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:18.122+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:18.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:18.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:19.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:19.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:19.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:19.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:20.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:20.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:20.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:20.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:21.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:21.132+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:21.218 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:21.216+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:22.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:22.167+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:22.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:22.241+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:23.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:23.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:23.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:23.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:24.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:24.182+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:24.267 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:24.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:25.209 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:25.208+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:25.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:25.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:26.245 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:26.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:26.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:26.251+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:27.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:27.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:27.242 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:27.241+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:28.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:28.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:28.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:28.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:29.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:29.233+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:29.245 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:29.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:30.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:30.189+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:30.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:30.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:31.175 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:31.174+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:31.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:31.211+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:32.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:32.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:32.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:32.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:33.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:33.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:33.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:33.260+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:34.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:34.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:34.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:34.254+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:35.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:35.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:35.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:35.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:36.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:36.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:36.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:36.248+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:37.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:37.045+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:37.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:37.285+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:38.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:38.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:38.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:38.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:39.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:39.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:39.296 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:39.294+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:39.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:39.989+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:40.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:40.304+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:40.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:40.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:41.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:41.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:41.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:41.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:42.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:42.265+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:42.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:42.961+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:43.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:43.234+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:43.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:43.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:44.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:44.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:44.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:44.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:45.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:45.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:45.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:45.947+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:46.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:46.214+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:46.943 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:46.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:47.246 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:47.244+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:47.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:47.931+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:48.263 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:48.261+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:48.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:48.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:49.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:49.267+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:49.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:49.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:50.242 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:50.240+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:50.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:50.895+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:51.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:51.276+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:51.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:51.909+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:52.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:52.271+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:52.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:52.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:53.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:53.248+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:53.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:53.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:54.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:54.271+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:54.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:54.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:55.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:55.232+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:55.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:55.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:56.284 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:56.281+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:57.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:57.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:57.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:57.250+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:58.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:58.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:58.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:58.258+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:59.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:13:59.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:13:59.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:13:59.233+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:00.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:00.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:00.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:00.210+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:01.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:01.089+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:01.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:01.215+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:02.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:02.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:02.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:02.185+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:03.079 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:03.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:03.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:03.211+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:04.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:04.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:04.181 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:04.179+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:05.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:05.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:05.174 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:05.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:06.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:06.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:06.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:06.220+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:07.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:07.069+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:07.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:07.189+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:08.052 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:08.051+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:08.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:08.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:09.069 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:09.068+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:09.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:09.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:10.108 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:10.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:10.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:10.240+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:11.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:11.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:11.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:11.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:12.171 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:12.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:12.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:12.266+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:13.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:13.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:13.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:13.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:14.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:14.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:14.307 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:14.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:15.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:15.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:15.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:15.342+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:16.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:16.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:16.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:16.348+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:17.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:17.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:17.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:17.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:18.145 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:18.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:18.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:18.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:19.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:19.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:19.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:19.361+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:20.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:20.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:20.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:20.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:21.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:21.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:21.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:21.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:22.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:22.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:22.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:22.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:23.128 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:23.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:23.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:23.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:24.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:24.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:24.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:24.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:25.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:25.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:25.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:25.396+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:26.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:26.145+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:26.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:26.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:27.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:27.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:27.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:27.372+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:28.121 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:28.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:28.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:28.411+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:29.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:29.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:29.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:29.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:30.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:30.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:30.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:30.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:31.204 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:31.202+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:31.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:31.445+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:32.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:32.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:32.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:32.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:33.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:33.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:33.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:33.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:34.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:34.212+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:34.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:34.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:35.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:35.184+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:35.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:35.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:36.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:36.156+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:36.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:36.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:37.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:37.151+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:37.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:37.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:38.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:38.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:38.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:38.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:39.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:39.158+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:39.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:39.580+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:40.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:40.146+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:40.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:40.549+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:41.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:41.098+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:41.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:41.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:42.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:42.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:42.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:42.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:43.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:43.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:43.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:43.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:44.037 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:44.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:44.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:44.520+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:45.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:45.044+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:45.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:45.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:46.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:46.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:46.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:46.443+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:46.985 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:46.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:47.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:47.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:48.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:48.008+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:48.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:48.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:49.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:49.003+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:49.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:49.516+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:49.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:49.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:50.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:50.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:50.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:50.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:51.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:51.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:51.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:51.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:52.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:52.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:53.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:53.007+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:53.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:53.462+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:54.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:54.025+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:54.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:54.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:55.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:55.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:55.448 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:55.447+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:55.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:55.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:56.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:56.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:56.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:56.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:57.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:57.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:57.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:57.986+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:58.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:58.509+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:59.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:14:59.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:14:59.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:14:59.524+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:00.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:00.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:00.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:00.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:01.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:01.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:01.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:01.560+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:02.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:02.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:02.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:02.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:03.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:03.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:03.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:03.574+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:04.109 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:04.107+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:04.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:04.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:05.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:05.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:05.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:05.520+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:06.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:06.204+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:06.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:06.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:07.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:07.190+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:07.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:07.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:08.192 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:08.190+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:08.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:08.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:09.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:09.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:09.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:09.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:10.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:10.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:10.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:10.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:11.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:11.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:11.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:11.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:12.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:12.076+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:12.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:12.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:13.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:13.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:13.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:13.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:14.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:14.055+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:14.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:14.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:15.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:15.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:15.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:15.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:16.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:16.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:16.617 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:16.614+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:17.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:17.103+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:17.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:17.596+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:18.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:18.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:18.614 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:18.612+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:19.114 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:19.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:19.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:19.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:20.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:20.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:20.599 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:20.597+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:21.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:21.053+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:21.628 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:21.626+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:22.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:22.007+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:22.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:22.632+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:22.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:22.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:23.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:23.618+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:23.980 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:23.978+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:24.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:24.635+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:24.999 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:24.996+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:25.671 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:25.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:25.963 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:25.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:26.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:26.707+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:26.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:26.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:27.700 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:27.698+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:28.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:28.025+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:28.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:28.743+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:29.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:29.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:29.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:29.778+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:30.099 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:30.098+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:30.787 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:30.786+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:31.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:31.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:31.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:31.804+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:32.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:32.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:32.824 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:32.821+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:33.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:33.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:33.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:33.777+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:34.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:34.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:34.752 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:34.751+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:35.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:35.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:35.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:35.705+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:36.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:36.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:36.726 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:36.725+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:37.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:37.171+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:37.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:37.690+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:38.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:38.143+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:38.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:38.737+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:39.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:39.165+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:39.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:39.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:40.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:40.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:40.776 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:40.775+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:41.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:41.169+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:41.816 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:41.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:42.220 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:42.217+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:42.784 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:42.782+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:43.255 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:43.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:43.822 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:43.820+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:44.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:44.248+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:44.799 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:44.797+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:45.276 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:45.274+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:45.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:45.825+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:46.296 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:46.294+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:46.804 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:46.802+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:47.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:47.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:47.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:47.789+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:48.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:48.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:48.803 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:48.800+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:49.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:49.250+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:49.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:49.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:50.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:50.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:50.773 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:50.771+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:51.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:51.232+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:51.736 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:51.734+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:52.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:52.251+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:52.700 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:52.698+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:53.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:53.204+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:53.690 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:53.688+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:54.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:54.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:54.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:54.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:55.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:55.213+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:55.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:55.619+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:56.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:56.260+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:56.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:56.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:57.280 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:57.278+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:57.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:57.642+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:58.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:58.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:58.694 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:58.692+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:59.282 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:15:59.280+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:15:59.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:15:59.662+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:00.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:00.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:00.639 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:00.637+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:01.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:01.260+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:01.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:01.664+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:02.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:02.255+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:02.703 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:02.701+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:03.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:03.211+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:03.708 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:03.705+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:04.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:04.209+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:04.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:04.662+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:05.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:05.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:05.649 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:05.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:06.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:06.295+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:06.633 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:06.631+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:07.340 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:07.337+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:07.665 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:07.663+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:08.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:08.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:08.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:08.703+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:09.328 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:09.325+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:09.665 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:09.662+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:10.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:10.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:10.640 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:10.638+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:11.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:11.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:11.618 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:11.616+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:12.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:12.286+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:12.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:12.644+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:13.288 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:13.287+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:13.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:13.658+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:14.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:14.276+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:14.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:14.663+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:15.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:15.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:15.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:15.645+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:16.266 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:16.265+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:16.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:16.620+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:17.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:17.266+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:17.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:17.646+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:18.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:18.299+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:18.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:18.598+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:19.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:19.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:19.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:19.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:20.320 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:20.319+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:20.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:20.524+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:21.279 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:21.277+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:21.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:21.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:22.324 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:22.323+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:22.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:22.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:23.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:23.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:23.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:23.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:24.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:24.357+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:24.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:24.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:25.382 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:25.379+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:25.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:25.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:26.388 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:26.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:26.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:26.570+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:27.369 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:27.367+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:27.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:27.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:28.392 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:28.390+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:28.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:28.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:29.362 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:29.360+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:29.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:29.581+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:30.341 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:30.339+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:30.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:30.549+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:31.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:31.389+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:31.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:31.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:32.438 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:32.435+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:32.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:32.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:33.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:33.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:33.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:33.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:34.461 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:34.458+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:34.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:34.546+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:35.452 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:35.450+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:35.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:35.589+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:36.438 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:36.436+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:36.635 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:36.633+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:37.406 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:37.404+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:37.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:37.618+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:38.381 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:38.379+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:38.597 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:38.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:39.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:39.426+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:39.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:39.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:40.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:40.417+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:40.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:40.575+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:41.421 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:41.419+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:41.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:41.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:42.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:42.414+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:42.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:42.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:43.462 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:43.460+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:43.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:43.554+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:44.483 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:44.481+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:44.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:44.598+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:45.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:45.501+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:45.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:45.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:46.552 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:46.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:46.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:46.550+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:47.516 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:47.514+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:47.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:47.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:48.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:48.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:48.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:48.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:49.512 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:49.510+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:49.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:49.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:50.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:50.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:50.544 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:50.542+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:51.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:51.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:51.518 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:51.516+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:52.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:52.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:52.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:52.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:53.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:53.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:53.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:53.580+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:54.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:54.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:54.553 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:54.551+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:55.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:55.504+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:55.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:55.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:56.499 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:56.497+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:56.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:56.568+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:57.501 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:57.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:57.617 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:57.616+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:58.517 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:58.515+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:58.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:58.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:59.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:16:59.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:16:59.671 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:16:59.669+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:00.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:00.574+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:00.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:00.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:01.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:01.555+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:01.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:01.590+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:02.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:02.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:02.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:02.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:03.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:03.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:03.585 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:03.583+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:04.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:04.563+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:04.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:04.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:05.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:05.577+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:05.611 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:05.609+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:06.534 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:06.532+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:06.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:06.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:07.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:07.572+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:07.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:07.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:08.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:08.549+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:08.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:08.576+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:09.561 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:09.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:09.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:09.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:10.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:10.538+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:10.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:10.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:11.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:11.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:11.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:11.579+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:12.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:12.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:12.579 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:12.576+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:13.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:13.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:13.609 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:13.607+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:14.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:14.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:14.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:14.610+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:15.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:15.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:15.604 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:15.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:16.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:16.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:16.563 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:16.561+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:17.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:17.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:17.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:17.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:18.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:18.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:18.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:18.508+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:19.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:19.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:19.549 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:19.546+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:20.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:20.443+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:20.525 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:20.523+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:21.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:21.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:21.510 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:21.508+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:22.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:22.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:22.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:22.471+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:23.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:23.447+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:23.475 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:23.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:24.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:24.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:24.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:24.425+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:25.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:25.368+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:25.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:25.394+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:26.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:26.415+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:26.446 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:26.444+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:27.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:27.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:27.449 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:27.447+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:28.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:28.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:28.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:28.477+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:29.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:29.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:29.508 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:29.506+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:30.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:30.425+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:30.469 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:30.466+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:31.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:31.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:31.458 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:31.456+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:32.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:32.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:32.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:32.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:33.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:33.397+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:33.441 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:33.439+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:34.385 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:34.383+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:34.417 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:34.415+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:35.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:35.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:35.405 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:35.403+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:36.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:36.344+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:36.411 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:36.409+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:37.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:37.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:37.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:37.426+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:38.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:38.421+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:38.445 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:38.442+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:39.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:39.395+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:39.444 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:39.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:40.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:40.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:40.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:40.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:41.360 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:41.359+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:41.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:41.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:42.385 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:42.384+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:42.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:42.422+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:43.371 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:43.370+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:43.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:43.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:44.419 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:44.418+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:44.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:44.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:45.396 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:45.395+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:45.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:45.506+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:46.425 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:46.424+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:46.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:46.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:47.449 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:47.447+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:47.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:47.503+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:48.456 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:48.454+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:48.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:48.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:49.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:49.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:49.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:49.471+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:50.443 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:50.440+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:50.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:50.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:51.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:51.438+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:51.463 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:51.461+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:52.397 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:52.395+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:52.511 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:52.509+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:53.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:53.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:53.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:53.545+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:54.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:54.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:54.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:54.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:55.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:55.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:55.556 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:55.554+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:56.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:56.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:56.511 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:56.509+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:57.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:57.395+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:57.472 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:57.469+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:58.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:58.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:58.478 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:58.476+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:59.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:17:59.325+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:17:59.493 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:17:59.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:00.299 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:00.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:00.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:00.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:01.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:01.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:01.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:01.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:02.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:02.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:02.623 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:02.621+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:03.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:03.368+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:03.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:03.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:04.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:04.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:04.593 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:04.590+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:05.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:05.422+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:05.616 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:05.613+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:06.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:06.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:06.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:06.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:07.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:07.367+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:07.645 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:07.642+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:08.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:08.415+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:08.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:08.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:09.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:09.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:09.650 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:09.647+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:10.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:10.443+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:10.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:10.656+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:11.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:11.405+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:11.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:11.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:12.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:12.431+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:12.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:12.666+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:13.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:13.425+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:13.663 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:13.661+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:14.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:14.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:14.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:14.658+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:15.405 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:15.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:15.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:15.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:16.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:16.451+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:16.694 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:16.692+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:17.441 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:17.439+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:17.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:17.656+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:18.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:18.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:18.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:18.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:19.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:19.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:19.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:19.658+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:20.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:20.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:20.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:20.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:21.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:21.508+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:21.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:21.679+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:22.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:22.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:22.724 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:22.723+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:23.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:23.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:23.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:23.688+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:24.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:24.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:24.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:24.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:25.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:25.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:25.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:25.664+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:26.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:26.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:26.696 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:26.694+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:27.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:27.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:27.680 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:27.679+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:28.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:28.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:28.727 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:28.726+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:29.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:29.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:29.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:29.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:30.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:30.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:30.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:30.717+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:31.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:31.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:31.688 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:31.686+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:32.540 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:32.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:32.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:32.695+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:33.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:33.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:33.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:33.668+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:34.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:34.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:34.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:34.709+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:35.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:35.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:35.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:35.686+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:36.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:36.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:36.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:36.669+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:37.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:37.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:37.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:37.669+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:38.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:38.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:38.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:38.716+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:39.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:39.598+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:39.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:39.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:40.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:40.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:40.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:40.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:41.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:41.606+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:41.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:41.733+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:42.643 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:42.640+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:42.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:42.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:43.622 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:43.619+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:43.792 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:43.790+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:44.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:44.642+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:44.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:44.838+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:45.671 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:45.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:45.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:45.836+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:46.716 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:46.713+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:46.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:46.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:47.689 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:47.686+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:47.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:47.823+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:48.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:48.657+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:48.863 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:48.860+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:49.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:49.629+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:49.851 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:49.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:50.630 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:50.627+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:50.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:50.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:51.654 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:51.652+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:51.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:51.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:52.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:52.683+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:52.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:52.839+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:53.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:53.673+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:53.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:53.814+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:54.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:54.629+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:54.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:54.832+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:55.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:55.582+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:55.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:55.790+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:56.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:56.540+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:56.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:56.784+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:57.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:57.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:57.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:57.777+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:58.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:58.550+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:58.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:58.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:59.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:18:59.565+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:18:59.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:18:59.836+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:00.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:00.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:00.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:00.788+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:01.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:01.561+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:01.841 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:01.837+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:02.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:02.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:02.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:02.856+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:03.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:03.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:03.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:03.810+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:04.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:04.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:04.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:04.797+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:05.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:05.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:05.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:05.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:06.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:06.508+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:06.820 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:06.818+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:07.515 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:07.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:07.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:07.807+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:08.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:08.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:08.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:08.853+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:09.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:09.503+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:09.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:09.843+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:10.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:10.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:10.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:10.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:11.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:11.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:11.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:11.807+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:12.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:12.499+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:12.785 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:12.784+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:13.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:13.475+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:13.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:13.739+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:14.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:14.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:14.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:14.736+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:15.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:15.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:15.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:15.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:16.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:16.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:16.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:16.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:17.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:17.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:17.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:17.779+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:18.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:18.520+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:18.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:18.763+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:19.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:19.520+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:19.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:19.794+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:20.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:20.546+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:20.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:20.779+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:21.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:21.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:21.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:21.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:22.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:22.530+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:22.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:22.777+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:23.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:23.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:23.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:23.784+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:24.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:24.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:24.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:24.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:25.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:25.548+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:25.731 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:25.729+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:26.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:26.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:26.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:26.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:27.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:27.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:27.768 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:27.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:28.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:28.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:28.807 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:28.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:29.628 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:29.626+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:29.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:29.813+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:30.617 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:30.615+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:30.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:30.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:31.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:31.617+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:31.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:31.781+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:32.573 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:32.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:32.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:32.773+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:33.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:33.591+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:33.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:33.735+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:34.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:34.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:34.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:34.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:35.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:35.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:35.720 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:35.718+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:36.633 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:36.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:36.729 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:36.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:37.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:37.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:37.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:37.707+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:38.633 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:38.631+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:38.674 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:38.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:39.670 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:39.667+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:39.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:39.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:40.677 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:40.674+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:40.773 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:40.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:41.630 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:41.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:41.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:41.800+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:42.662 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:42.659+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:42.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:42.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:43.654 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:43.651+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:43.816 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:43.813+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:44.674 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:44.671+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:44.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:44.782+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:45.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:45.692+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:45.792 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:45.790+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:46.704 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:46.701+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:46.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:46.750+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:47.719 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:47.718+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:47.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:47.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:48.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:48.704+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:48.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:48.755+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:49.707 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:49.706+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:49.793 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:49.792+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:50.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:50.674+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:50.821 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:50.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:51.715 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:51.714+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:51.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:51.778+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:52.695 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:52.693+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:52.818 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:52.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:53.708 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:53.706+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:53.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:53.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:54.740 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:54.738+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:54.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:54.819+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:55.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:55.761+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:55.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:55.827+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:56.805 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:56.804+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:56.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:56.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:57.801 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:57.800+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:57.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:57.854+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:58.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:58.831+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:58.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:58.862+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:59.825 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:19:59.823+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:19:59.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:19:59.843+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:00.786 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:00.782+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:00.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:00.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:01.796 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:01.794+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:01.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:01.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:02.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:02.746+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:02.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:02.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:03.789 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:03.787+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:03.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:03.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:04.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:04.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:04.820 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:04.817+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:05.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:05.803+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:05.820 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:05.818+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:06.803 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:06.800+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:06.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:06.817+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:07.755 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:07.753+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:07.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:07.792+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:08.738 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:08.735+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:08.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:08.779+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:09.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:09.756+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:09.785 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:09.783+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:10.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:10.739+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:10.783 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:10.781+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:11.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:11.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:11.816 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:11.813+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:12.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:12.796+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:12.859 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:12.857+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:13.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:13.773+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:13.824 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:13.817+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:14.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:14.730+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:14.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:14.820+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:15.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:15.772+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:15.842 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:15.839+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:16.811 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:16.808+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:16.847 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:16.844+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:17.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:17.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:17.831 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:17.828+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:18.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:18.777+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:18.811 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:18.809+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:19.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:19.773+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:19.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:19.797+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:20.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:20.805+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:20.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:20.838+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:21.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:21.792+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:21.804 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:21.802+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:22.803 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:22.800+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:22.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:22.835+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:23.767 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:23.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:23.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:23.824+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:24.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:24.767+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:24.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:24.858+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:25.768 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:25.765+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:25.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:25.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:26.782 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:26.780+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:26.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:26.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:27.784 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:27.782+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:27.916 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:27.914+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:28.788 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:28.786+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:28.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:28.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:29.759 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:29.756+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:29.975 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:29.972+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:30.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:30.767+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:31.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:31.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:31.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:31.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:31.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:31.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:32.735 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:32.734+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:32.981 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:32.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:33.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:33.720+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:33.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:33.950+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:34.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:34.700+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:34.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:34.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:35.670 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:35.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:35.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:35.994+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:36.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:36.696+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:37.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:37.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:37.665 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:37.664+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:38.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:38.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:38.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:38.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:39.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:39.000+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:39.614 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:39.612+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:39.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:39.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:40.653 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:40.652+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:40.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:40.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:41.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:41.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:41.978 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:41.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:42.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:42.633+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:42.945 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:42.943+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:43.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:43.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:43.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:43.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:44.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:44.652+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:44.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:44.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:45.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:45.649+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:45.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:45.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:46.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:46.676+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:46.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:46.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:47.659 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:47.657+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:47.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:47.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:48.681 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:48.679+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:48.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:48.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:49.710 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:49.707+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:49.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:49.824+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:50.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:50.743+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:50.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:50.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:51.790 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:51.787+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:51.862 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:51.859+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:52.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:52.777+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:52.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:52.825+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:53.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:53.776+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:53.820 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:53.818+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:54.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:54.747+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:54.817 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:54.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:55.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:55.710+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:55.860 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:55.858+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:56.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:56.719+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:56.864 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:56.861+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:57.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:57.740+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:57.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:57.874+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:58.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:58.704+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:58.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:58.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:59.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:20:59.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:20:59.867 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:20:59.864+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:00.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:00.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:00.911 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:00.909+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:01.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:01.747+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:01.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:01.932+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:02.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:02.721+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:02.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:02.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:03.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:03.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:03.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:03.938+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:04.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:04.700+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:04.972 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:04.970+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:05.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:05.653+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:05.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:05.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:06.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:06.652+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:06.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:06.976+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:07.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:07.619+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:08.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:08.006+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:08.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:08.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:09.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:09.046+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:09.676 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:09.674+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:10.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:10.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:10.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:10.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:11.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:10.997+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:11.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:11.759+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:12.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:12.005+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:12.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:12.783+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:12.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:12.976+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:13.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:13.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:13.993 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:13.990+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:14.783 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:14.781+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:14.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:14.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:15.790 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:15.789+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:15.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:15.930+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:16.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:16.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:16.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:16.922+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:17.815 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:17.814+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:17.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:17.914+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:18.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:18.830+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:18.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:18.948+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:19.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:19.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:19.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:19.901+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:20.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:20.778+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:20.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:20.950+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:21.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:21.763+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:21.920 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:21.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:22.779 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:22.777+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:22.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:22.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:23.780 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:23.778+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:23.876 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:23.874+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:24.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:24.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:24.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:24.878+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:25.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:25.731+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:25.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:25.913+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:26.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:26.731+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:26.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:26.885+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:27.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:27.706+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:27.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:27.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:28.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:28.675+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:28.903 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:28.900+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:29.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:29.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:29.888 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:29.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:30.715 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:30.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:30.906 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:30.904+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:31.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:31.664+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:31.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:31.912+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:32.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:32.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:32.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:32.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:33.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:33.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:33.885 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:33.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:34.648 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:34.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:34.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:34.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:35.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:35.599+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:35.887 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:35.884+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:36.624 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:36.622+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:36.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:36.898+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:37.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:37.630+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:37.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:37.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:38.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:38.590+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:38.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:38.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:39.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:39.618+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:39.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:39.941+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:40.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:40.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:40.900 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:40.897+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:41.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:41.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:41.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:41.936+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:42.657 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:42.654+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:42.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:42.942+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:43.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:43.673+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:43.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:43.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:44.707 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:44.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:44.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:44.925+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:45.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:45.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:45.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:45.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:46.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:46.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:46.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:46.947+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:47.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:47.723+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:47.932 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:47.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:48.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:48.684+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:48.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:48.961+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:49.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:49.657+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:50.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:50.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:50.657 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:50.655+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:51.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:51.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:51.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:51.657+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:52.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:52.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:52.627 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:52.624+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:53.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:53.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:53.652 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:53.650+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:54.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:54.103+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:54.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:54.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:55.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:55.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:55.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:55.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:56.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:56.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:56.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:56.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:57.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:57.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:57.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:57.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:58.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:58.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:58.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:58.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:59.145 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:21:59.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:21:59.618 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:21:59.616+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:00.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:00.186+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:00.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:00.579+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:01.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:01.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:01.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:01.565+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:02.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:02.135+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:02.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:02.535+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:03.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:03.115+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:03.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:03.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:04.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:04.096+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:04.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:04.571+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:05.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:05.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:05.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:05.536+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:06.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:06.141+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:06.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:06.572+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:07.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:07.189+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:07.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:07.586+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:08.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:08.234+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:08.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:08.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:09.222 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:09.220+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:09.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:09.624+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:10.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:10.245+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:10.603 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:10.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:11.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:11.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:11.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:11.562+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:12.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:12.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:12.563 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:12.560+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:13.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:13.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:13.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:13.559+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:14.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:14.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:14.553 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:14.550+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:15.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:15.236+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:15.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:15.593+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:16.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:16.238+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:16.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:16.545+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:17.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:17.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:17.503 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:17.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:17.515 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-06T07:22:17.515 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T07:22:17.513+0000 7efd5bfff700 -1 Fail to read '/proc/118589/cmdline' error = (3) No such process 2023-12-06T07:22:17.515 INFO:tasks.workunit.client.0.smithi134.stderr:2023-12-06T07:22:17.513+0000 7efd5bfff700 -1 received signal: Terminated from (PID: 118589) UID: 1000 2023-12-06T07:22:18.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:18.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:18.474 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:18.472+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:19.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:19.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:19.456 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:19.453+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:20.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:20.251+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:20.456 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:20.454+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:21.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:21.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:21.481 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:21.479+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:22.238 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:22.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:22.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:22.478+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:23.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:23.228+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:23.453 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:23.451+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:24.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:24.192+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:24.477 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:24.475+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:25.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:25.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:25.437 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:25.434+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:26.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:26.232+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:26.393 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:26.388+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:27.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:27.192+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:27.363 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:27.360+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:28.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:28.170+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:28.322 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:28.319+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:29.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:29.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:29.309 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:29.307+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:30.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:30.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:30.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:30.259+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:31.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:31.159+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:31.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:31.273+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:32.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:32.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:32.272 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:32.270+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:33.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:33.204+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:33.318 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:33.316+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:34.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:34.208+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:34.368 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:34.365+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:35.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:35.181+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:35.345 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:35.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:36.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:36.203+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:36.377 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:36.374+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:37.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:37.240+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:37.422 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:37.420+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:38.291 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:38.289+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:38.454 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:38.452+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:39.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:39.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:39.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:39.412+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:40.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:40.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:40.413 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:40.412+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:41.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:41.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:41.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:41.365+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:42.283 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:42.282+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:42.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:42.351+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:43.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:43.288+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:43.374 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:43.373+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:44.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:44.240+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:44.365 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:44.363+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:45.275 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:45.274+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:45.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:45.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:46.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:46.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:46.391 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:46.390+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:47.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:47.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:47.343 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:47.342+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:48.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:48.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:48.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:48.348+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:49.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:49.225+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:49.301 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:49.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:50.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:50.269+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:50.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:50.274+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:51.277 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:51.275+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:51.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:51.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:52.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:52.274+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:52.307 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:52.305+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:53.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:53.225+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:53.303 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:53.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:54.260 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:54.258+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:54.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:54.263+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:55.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:55.216+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:55.313 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:55.310+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:56.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:56.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:56.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:56.290+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:57.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:57.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:57.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:57.243+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:58.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:58.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:58.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:58.211+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:59.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:22:59.189+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:22:59.209 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:22:59.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:00.213 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:00.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:00.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:00.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:01.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:01.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:01.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:01.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:02.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:02.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:02.296 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:02.294+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:03.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:03.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:03.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:03.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:04.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:04.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:04.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:04.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:05.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:05.167+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:05.313 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:05.311+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:06.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:06.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:06.273 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:06.271+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:07.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:07.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:07.305 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:07.302+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:08.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:08.145+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:08.353 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:08.351+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:09.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:09.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:09.314 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:09.311+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:10.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:10.175+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:10.309 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:10.306+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:11.194 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:11.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:11.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:11.308+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:12.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:12.197+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:12.347 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:12.345+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:13.229 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:13.227+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:13.337 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:13.335+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:14.279 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:14.276+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:14.384 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:14.381+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:15.329 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:15.327+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:15.362 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:15.359+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:16.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:16.286+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:16.338 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:16.335+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:17.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:17.244+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:17.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:17.348+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:17.516 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-12-06T07:23:18.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:18.241+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:18.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:18.345+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:19.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:19.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:19.398 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:19.396+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:20.258 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:20.256+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:20.403 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:20.400+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:21.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:21.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:21.424 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:21.421+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:22.277 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:22.274+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:22.469 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:22.467+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:23.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:23.290+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:23.455 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:23.453+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:24.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:24.332+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:24.431 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:24.429+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:25.287 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:25.285+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:25.454 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:25.453+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:26.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:26.240+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:26.486 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:26.484+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:27.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:27.214+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:27.512 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:27.511+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:28.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:28.263+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:28.537 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:28.536+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:29.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:29.263+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:29.543 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:29.541+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:30.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:30.234+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:30.533 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:30.529+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:31.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:31.232+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:31.562 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:31.560+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:32.231 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:32.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:32.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:32.586+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:33.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:33.184+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:33.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:33.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:34.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:34.230+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:34.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:34.597+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:35.271 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:35.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:35.592 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:35.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:36.292 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:36.290+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:36.569 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:36.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:37.337 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:37.335+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:37.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:37.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:38.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:38.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:38.622 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:38.620+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:39.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:39.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:39.629 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:39.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:40.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:40.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:40.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:40.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:41.331 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:41.328+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:41.550 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:41.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:42.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:42.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:42.520 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:42.518+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:43.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:43.295+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:43.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:43.499+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:44.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:44.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:44.495 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:44.492+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:45.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:45.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:45.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:45.500+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:46.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:46.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:46.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:46.539+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:47.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:47.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:47.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:47.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:48.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:48.390+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:48.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:48.618+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:49.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:49.400+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:49.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:49.631+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:50.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:50.440+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:50.608 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:50.606+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:51.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:51.432+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:51.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:51.640+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:52.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:52.420+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:52.632 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:52.630+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:53.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:53.408+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:53.660 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:53.658+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:54.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:54.455+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:54.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:54.642+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:55.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:55.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:55.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:55.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:56.448 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:56.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:56.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:56.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:57.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:57.487+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:57.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:57.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:58.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:58.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:58.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:58.632+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:59.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:23:59.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:23:59.587 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:23:59.585+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:00.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:00.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:00.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:00.600+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:01.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:01.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:01.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:01.596+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:02.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:02.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:02.616 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:02.614+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:03.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:03.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:03.656 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:03.653+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:04.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:04.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:04.678 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:04.675+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:05.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:05.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:05.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:05.671+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:06.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:06.520+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:06.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:06.678+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:07.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:07.491+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:07.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:07.693+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:08.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:08.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:08.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:08.708+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:09.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:09.511+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:09.740 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:09.738+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:10.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:10.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:10.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:10.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:11.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:11.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:11.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:11.722+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:12.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:12.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:12.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:12.700+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:13.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:13.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:13.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:13.726+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:14.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:14.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:14.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:14.701+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:15.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:15.538+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:15.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:15.733+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:16.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:16.575+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:16.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:16.686+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:17.518 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-12-06T07:24:17.518 INFO:tasks.workunit:Stopping ['rbd/cli_generic.sh'] on client.0... 2023-12-06T07:24:17.519 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-12-06T07:24:17.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:17.610+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:17.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:17.706+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:17.773 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi134 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d03fca4f35d43f61b4679936aef7bd2f01cced0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-12-06T07:24:17.936 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a409c80a42b94c2bad588f250cd3b030 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi134 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d03fca4f35d43f61b4679936aef7bd2f01cced0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-12-06T07:24:17.939 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-06T07:24:17.971 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-12-06T07:24:17.972 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T07:24:18.282 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:24:18.282 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":159,"fsid":"4e38094a-d24c-4240-bea0-15d2d8796a3c","created":"2023-12-06T04:21:07.554985+0000","modified":"2023-12-06T05:24:33.053325+0000","last_up_change":"2023-12-06T04:21:15.523261+0000","last_in_change":"2023-12-06T04:21:08.532916+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-06T04:21:15.563089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-06T04:21:16.228970+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-12-06T04:21:23.723467+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"6c916e77-1f95-4e1b-811f-8bee318dbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":114486},{"type":"v1","addr":"172.21.15.134:6801","nonce":114486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":114486},{"type":"v1","addr":"172.21.15.134:6803","nonce":114486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":114486},{"type":"v1","addr":"172.21.15.134:6807","nonce":114486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":114486},{"type":"v1","addr":"172.21.15.134:6805","nonce":114486}]},"public_addr":"172.21.15.134:6801/114486","cluster_addr":"172.21.15.134:6803/114486","heartbeat_back_addr":"172.21.15.134:6807/114486","heartbeat_front_addr":"172.21.15.134:6805/114486","state":["exists","up"]},{"osd":1,"uuid":"c992bccd-c2b5-45be-916a-d3ce77576215","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":114487},{"type":"v1","addr":"172.21.15.134:6809","nonce":114487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":114487},{"type":"v1","addr":"172.21.15.134:6811","nonce":114487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":114487},{"type":"v1","addr":"172.21.15.134:6815","nonce":114487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":114487},{"type":"v1","addr":"172.21.15.134:6813","nonce":114487}]},"public_addr":"172.21.15.134:6809/114487","cluster_addr":"172.21.15.134:6811/114487","heartbeat_back_addr":"172.21.15.134:6815/114487","heartbeat_front_addr":"172.21.15.134:6813/114487","state":["exists","up"]},{"osd":2,"uuid":"d5865df4-d87f-4cbb-a273-ed6b54e0d8ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":114516},{"type":"v1","addr":"172.21.15.134:6817","nonce":114516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":114516},{"type":"v1","addr":"172.21.15.134:6819","nonce":114516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":114516},{"type":"v1","addr":"172.21.15.134:6823","nonce":114516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":114516},{"type":"v1","addr":"172.21.15.134:6821","nonce":114516}]},"public_addr":"172.21.15.134:6817/114516","cluster_addr":"172.21.15.134:6819/114516","heartbeat_back_addr":"172.21.15.134:6823/114516","heartbeat_front_addr":"172.21.15.134:6821/114516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.721009+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.761363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.759135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T07:24:18.296 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-06T07:24:18.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:24:18.588 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:24:18.590 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:24:18.603 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5647,"stamp":"2023-12-06T07:24:18.112187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25096,"ondisk_log_size":25096,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001937"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1381","reported_seq":2447,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.382837+0000","last_change":"2023-12-06T04:25:51.581780+0000","last_active":"2023-12-06T05:24:28.382837+0000","last_peered":"2023-12-06T05:24:28.382837+0000","last_clean":"2023-12-06T05:24:28.382837+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T05:24:28.382837+0000","last_undegraded":"2023-12-06T05:24:28.382837+0000","last_fullsized":"2023-12-06T05:24:28.382837+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1381,"ondisk_log_size":1381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'812","reported_seq":1663,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.382881+0000","last_change":"2023-12-06T04:25:51.581723+0000","last_active":"2023-12-06T05:24:28.382881+0000","last_peered":"2023-12-06T05:24:28.382881+0000","last_clean":"2023-12-06T05:24:28.382881+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T05:24:28.382881+0000","last_undegraded":"2023-12-06T05:24:28.382881+0000","last_fullsized":"2023-12-06T05:24:28.382881+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":812,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7896,"ondisk_log_size":7896,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740569,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22,"15min":0.222},"min":{"1min":0.152,"5min":0.14299999999999999,"15min":0.14199999999999999},"max":{"1min":0.38800000000000001,"5min":0.46200000000000002,"15min":0.503},"last":0.251},{"interface":"front","average":{"1min":0.252,"5min":0.255,"15min":0.25800000000000001},"min":{"1min":0.19800000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.496},"last":0.27000000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.224,"15min":0.224},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.154},"max":{"1min":0.439,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.254,"15min":0.255},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17499999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48499999999999999},"last":0.28999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740570,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"min":{"1min":0.16600000000000001,"5min":0.14499999999999999,"15min":0.14000000000000001},"max":{"1min":0.36599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.27300000000000002,"15min":0.27000000000000002},"min":{"1min":0.184,"5min":0.18099999999999999,"15min":0.17299999999999999},"max":{"1min":0.442,"5min":0.498,"15min":0.498},"last":0.25700000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.24099999999999999,"15min":0.23999999999999999},"min":{"1min":0.192,"5min":0.17299999999999999,"15min":0.14999999999999999},"max":{"1min":0.40000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.249,"15min":0.248},"min":{"1min":0.19500000000000001,"5min":0.17799999999999999,"15min":0.16900000000000001},"max":{"1min":0.40999999999999998,"5min":0.45700000000000002,"15min":0.51900000000000002},"last":0.28499999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740574,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.223,"15min":0.218},"min":{"1min":0.14999999999999999,"5min":0.13300000000000001,"15min":0.126},"max":{"1min":0.36099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.27900000000000003,"15min":0.27200000000000002},"min":{"1min":0.20499999999999999,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.432,"5min":0.46100000000000002,"15min":0.504},"last":0.22800000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"min":{"1min":0.17999999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.38600000000000001,"5min":0.433,"15min":0.45200000000000001},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.253,"5min":0.26700000000000002,"15min":0.26400000000000001},"min":{"1min":0.19,"5min":0.187,"15min":0.187},"max":{"1min":0.41099999999999998,"5min":0.436,"15min":0.48099999999999998},"last":0.20699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:24:18.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:24:18.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:18.643+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:18.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:18.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:18.900 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:24:18.901 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:24:18.912 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5647,"stamp":"2023-12-06T07:24:18.112187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25096,"ondisk_log_size":25096,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001937"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1381","reported_seq":2447,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.382837+0000","last_change":"2023-12-06T04:25:51.581780+0000","last_active":"2023-12-06T05:24:28.382837+0000","last_peered":"2023-12-06T05:24:28.382837+0000","last_clean":"2023-12-06T05:24:28.382837+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T05:24:28.382837+0000","last_undegraded":"2023-12-06T05:24:28.382837+0000","last_fullsized":"2023-12-06T05:24:28.382837+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1381,"ondisk_log_size":1381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'812","reported_seq":1663,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.382881+0000","last_change":"2023-12-06T04:25:51.581723+0000","last_active":"2023-12-06T05:24:28.382881+0000","last_peered":"2023-12-06T05:24:28.382881+0000","last_clean":"2023-12-06T05:24:28.382881+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T05:24:28.382881+0000","last_undegraded":"2023-12-06T05:24:28.382881+0000","last_fullsized":"2023-12-06T05:24:28.382881+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":812,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7896,"ondisk_log_size":7896,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740569,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22,"15min":0.222},"min":{"1min":0.152,"5min":0.14299999999999999,"15min":0.14199999999999999},"max":{"1min":0.38800000000000001,"5min":0.46200000000000002,"15min":0.503},"last":0.251},{"interface":"front","average":{"1min":0.252,"5min":0.255,"15min":0.25800000000000001},"min":{"1min":0.19800000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.496},"last":0.27000000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.224,"15min":0.224},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.154},"max":{"1min":0.439,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.254,"15min":0.255},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17499999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48499999999999999},"last":0.28999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740570,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"min":{"1min":0.16600000000000001,"5min":0.14499999999999999,"15min":0.14000000000000001},"max":{"1min":0.36599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.27300000000000002,"15min":0.27000000000000002},"min":{"1min":0.184,"5min":0.18099999999999999,"15min":0.17299999999999999},"max":{"1min":0.442,"5min":0.498,"15min":0.498},"last":0.25700000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.24099999999999999,"15min":0.23999999999999999},"min":{"1min":0.192,"5min":0.17299999999999999,"15min":0.14999999999999999},"max":{"1min":0.40000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.249,"15min":0.248},"min":{"1min":0.19500000000000001,"5min":0.17799999999999999,"15min":0.16900000000000001},"max":{"1min":0.40999999999999998,"5min":0.45700000000000002,"15min":0.51900000000000002},"last":0.28499999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740574,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.223,"15min":0.218},"min":{"1min":0.14999999999999999,"5min":0.13300000000000001,"15min":0.126},"max":{"1min":0.36099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.27900000000000003,"15min":0.27200000000000002},"min":{"1min":0.20499999999999999,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.432,"5min":0.46100000000000002,"15min":0.504},"last":0.22800000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"min":{"1min":0.17999999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.38600000000000001,"5min":0.433,"15min":0.45200000000000001},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.253,"5min":0.26700000000000002,"15min":0.26400000000000001},"min":{"1min":0.19,"5min":0.187,"15min":0.187},"max":{"1min":0.41099999999999998,"5min":0.436,"15min":0.48099999999999998},"last":0.20699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:24:18.913 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-06T07:24:18.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:24:19.245 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:24:19.247 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:24:19.259 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5647,"stamp":"2023-12-06T07:24:18.112187+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25096,"ondisk_log_size":25096,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001937"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1381","reported_seq":2447,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.382837+0000","last_change":"2023-12-06T04:25:51.581780+0000","last_active":"2023-12-06T05:24:28.382837+0000","last_peered":"2023-12-06T05:24:28.382837+0000","last_clean":"2023-12-06T05:24:28.382837+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T05:24:28.382837+0000","last_undegraded":"2023-12-06T05:24:28.382837+0000","last_fullsized":"2023-12-06T05:24:28.382837+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1381,"ondisk_log_size":1381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'812","reported_seq":1663,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.382881+0000","last_change":"2023-12-06T04:25:51.581723+0000","last_active":"2023-12-06T05:24:28.382881+0000","last_peered":"2023-12-06T05:24:28.382881+0000","last_clean":"2023-12-06T05:24:28.382881+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T05:24:28.382881+0000","last_undegraded":"2023-12-06T05:24:28.382881+0000","last_fullsized":"2023-12-06T05:24:28.382881+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":812,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7896,"ondisk_log_size":7896,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740569,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22,"15min":0.222},"min":{"1min":0.152,"5min":0.14299999999999999,"15min":0.14199999999999999},"max":{"1min":0.38800000000000001,"5min":0.46200000000000002,"15min":0.503},"last":0.251},{"interface":"front","average":{"1min":0.252,"5min":0.255,"15min":0.25800000000000001},"min":{"1min":0.19800000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.496},"last":0.27000000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:23:21 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.224,"15min":0.224},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.154},"max":{"1min":0.439,"5min":0.45100000000000001,"15min":0.45100000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.254,"15min":0.255},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.17499999999999999},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48499999999999999},"last":0.28999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740570,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"min":{"1min":0.16600000000000001,"5min":0.14499999999999999,"15min":0.14000000000000001},"max":{"1min":0.36599999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.27300000000000002,"15min":0.27000000000000002},"min":{"1min":0.184,"5min":0.18099999999999999,"15min":0.17299999999999999},"max":{"1min":0.442,"5min":0.498,"15min":0.498},"last":0.25700000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:24:02 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.24099999999999999,"15min":0.23999999999999999},"min":{"1min":0.192,"5min":0.17299999999999999,"15min":0.14999999999999999},"max":{"1min":0.40000000000000002,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.249,"15min":0.248},"min":{"1min":0.19500000000000001,"5min":0.17799999999999999,"15min":0.16900000000000001},"max":{"1min":0.40999999999999998,"5min":0.45700000000000002,"15min":0.51900000000000002},"last":0.28499999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740574,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.21099999999999999,"5min":0.223,"15min":0.218},"min":{"1min":0.14999999999999999,"5min":0.13300000000000001,"15min":0.126},"max":{"1min":0.36099999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.27900000000000003,"15min":0.27200000000000002},"min":{"1min":0.20499999999999999,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.432,"5min":0.46100000000000002,"15min":0.504},"last":0.22800000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:24:06 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.24099999999999999,"15min":0.23400000000000001},"min":{"1min":0.17999999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.38600000000000001,"5min":0.433,"15min":0.45200000000000001},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.253,"5min":0.26700000000000002,"15min":0.26400000000000001},"min":{"1min":0.19,"5min":0.187,"15min":0.187},"max":{"1min":0.41099999999999998,"5min":0.436,"15min":0.48099999999999998},"last":0.20699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:24:19.260 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-06T07:24:19.601 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:24:19.601 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":159,"fsid":"4e38094a-d24c-4240-bea0-15d2d8796a3c","created":"2023-12-06T04:21:07.554985+0000","modified":"2023-12-06T05:24:33.053325+0000","last_up_change":"2023-12-06T04:21:15.523261+0000","last_in_change":"2023-12-06T04:21:08.532916+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-12-06T04:21:15.563089+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-12-06T04:21:16.228970+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-12-06T04:21:23.723467+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"15","last_force_op_resend_prenautilus":"15","last_force_op_resend_preluminous":"15","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":153,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"6c916e77-1f95-4e1b-811f-8bee318dbfa3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":114486},{"type":"v1","addr":"172.21.15.134:6801","nonce":114486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":114486},{"type":"v1","addr":"172.21.15.134:6803","nonce":114486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":114486},{"type":"v1","addr":"172.21.15.134:6807","nonce":114486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":114486},{"type":"v1","addr":"172.21.15.134:6805","nonce":114486}]},"public_addr":"172.21.15.134:6801/114486","cluster_addr":"172.21.15.134:6803/114486","heartbeat_back_addr":"172.21.15.134:6807/114486","heartbeat_front_addr":"172.21.15.134:6805/114486","state":["exists","up"]},{"osd":1,"uuid":"c992bccd-c2b5-45be-916a-d3ce77576215","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":114487},{"type":"v1","addr":"172.21.15.134:6809","nonce":114487}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":114487},{"type":"v1","addr":"172.21.15.134:6811","nonce":114487}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":114487},{"type":"v1","addr":"172.21.15.134:6815","nonce":114487}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":114487},{"type":"v1","addr":"172.21.15.134:6813","nonce":114487}]},"public_addr":"172.21.15.134:6809/114487","cluster_addr":"172.21.15.134:6811/114487","heartbeat_back_addr":"172.21.15.134:6815/114487","heartbeat_front_addr":"172.21.15.134:6813/114487","state":["exists","up"]},{"osd":2,"uuid":"d5865df4-d87f-4cbb-a273-ed6b54e0d8ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":114516},{"type":"v1","addr":"172.21.15.134:6817","nonce":114516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":114516},{"type":"v1","addr":"172.21.15.134:6819","nonce":114516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":114516},{"type":"v1","addr":"172.21.15.134:6823","nonce":114516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":114516},{"type":"v1","addr":"172.21.15.134:6821","nonce":114516}]},"public_addr":"172.21.15.134:6817/114516","cluster_addr":"172.21.15.134:6819/114516","heartbeat_back_addr":"172.21.15.134:6823/114516","heartbeat_front_addr":"172.21.15.134:6821/114516","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.721009+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.761363+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-12-06T04:21:13.759135+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-06T07:24:19.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:19.673+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:19.792 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:19.790+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:20.615 INFO:tasks.ceph:Scrubbing osd.0 2023-12-06T07:24:20.616 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-06T07:24:20.644 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:20.641+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:20.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:20.763+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:21.694 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:21.691+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:21.738 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:21.736+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:22.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:22.689+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:22.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:22.703+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:23.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:23.673+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:23.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:23.732+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:24.683 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:24.680+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:24.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:24.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:25.704 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:25.701+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:25.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:25.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:26.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:26.672+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:26.740 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:26.738+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:27.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:27.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:27.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:27.707+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:28.635 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:28.633+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:28.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:28.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:29.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:29.640+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:29.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:29.683+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:30.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:30.677+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:30.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:30.688+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:31.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:31.634+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:31.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:31.669+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:32.631 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:32.629+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:32.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:32.635+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:33.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:33.634+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:33.679 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:33.677+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:34.614 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:34.612+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:34.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:34.684+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:35.572 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:35.570+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:35.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:35.641+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:36.576 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:36.574+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:36.655 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:36.652+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:37.616 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:37.613+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:37.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:37.623+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:38.617 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:38.614+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:38.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:38.629+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:39.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:39.581+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:39.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:39.669+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:40.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:40.579+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:40.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:40.639+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:41.622 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:41.620+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:41.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:41.623+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:42.586 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:42.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:42.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:42.599+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:43.551 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:43.548+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:43.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:43.589+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:44.559 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:44.557+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:44.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:44.640+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:45.580 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:45.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:45.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:45.689+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:46.620 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:46.618+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:46.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:46.670+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:47.608 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:47.606+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:47.632 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:47.630+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:48.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:48.635+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:48.639 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:48.638+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:49.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:49.622+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:49.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:49.627+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:50.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:50.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:50.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:50.670+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:51.635 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:51.633+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:51.654 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:51.653+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:52.608 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:52.607+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:52.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:52.612+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:53.583 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:53.582+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:53.616 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:53.615+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:54.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:54.611+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:54.615 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:54.614+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:55.618 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:55.617+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:55.626 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:55.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:56.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:56.594+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:56.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:56.671+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:57.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:57.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:57.636 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:57.634+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:58.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:58.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:58.619 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:58.617+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:59.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:24:59.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:24:59.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:24:59.632+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:00.617 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:00.614+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:00.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:00.673+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:01.648 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:01.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:01.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:01.661+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:02.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:02.687+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:02.700 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:02.698+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:03.722 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:03.719+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:03.737 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:03.735+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:04.702 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:04.699+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:04.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:04.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:05.702 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:05.700+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:05.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:05.807+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:06.728 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:06.726+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:06.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:06.772+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:07.684 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:07.682+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:07.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:07.744+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:08.668 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:08.666+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:08.791 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:08.788+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:09.650 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:09.647+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:09.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:09.761+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:10.671 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:10.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:10.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:10.798+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:11.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:11.662+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:11.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:11.835+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:12.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:12.693+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:12.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:12.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:13.699 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:13.697+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:13.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:13.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:14.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:14.739+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:14.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:14.823+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:15.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:15.740+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:15.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:15.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:16.703 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:16.700+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:16.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:16.817+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:17.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:17.750+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:17.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:17.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:18.796 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:18.794+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:18.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:18.862+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:19.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:19.820+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:19.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:19.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:20.784 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:20.782+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:20.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:20.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:21.831 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:21.829+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:21.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:21.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:22.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:22.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:22.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:22.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:23.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:23.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:23.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:23.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:24.813 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:24.811+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:24.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:24.877+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:25.773 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:25.770+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:25.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:25.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:26.815 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:26.813+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:26.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:26.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:27.860 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:27.858+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:27.945 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:27.942+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:28.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:28.868+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:28.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:28.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:29.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:29.875+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:29.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:29.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:30.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:30.905+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:30.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:30.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:31.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:31.938+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:31.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:31.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:32.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:32.945+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:32.968 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:32.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:33.916 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:33.914+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:34.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:34.008+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:34.930 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:34.928+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:35.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:35.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:35.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:35.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:36.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:36.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:36.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:36.932+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:37.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:37.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:37.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:37.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:38.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:38.057+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:38.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:38.976+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:39.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:39.029+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:39.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:39.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:39.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:39.996+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:41.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:41.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:41.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:41.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:41.970 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:41.968+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:42.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:42.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:42.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:42.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:43.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:43.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:43.925 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:43.923+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:44.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:44.053+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:44.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:44.913+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:45.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:45.006+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:45.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:45.889+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:46.000 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:45.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:46.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:46.848+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:46.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:46.960+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:47.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:47.803+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:47.931 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:47.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:48.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:48.800+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:48.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:48.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:49.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:49.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:49.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:49.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:50.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:50.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:50.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:50.906+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:51.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:51.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:51.926 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:51.924+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:52.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:52.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:52.919 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:52.917+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:53.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:53.773+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:53.957 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:53.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:54.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:54.747+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:54.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:54.922+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:55.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:55.702+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:55.915 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:55.912+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:56.712 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:56.709+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:56.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:56.891+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:57.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:57.679+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:57.904 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:57.901+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:58.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:58.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:58.953 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:58.950+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:59.685 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:25:59.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:25:59.917 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:25:59.915+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:00.640 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:00.638+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:00.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:00.936+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:01.593 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:01.591+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:01.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:01.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:02.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:02.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:02.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:02.967+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:03.634 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:03.631+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:04.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:03.999+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:04.591 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:04.589+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:04.975 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:04.972+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:05.641 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:05.639+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:05.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:05.962+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:06.691 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:06.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:06.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:06.977+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:07.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:07.726+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:07.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:07.976+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:08.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:08.774+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:09.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:09.008+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:09.808 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:09.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:10.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:10.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:10.761 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:10.758+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:11.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:11.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:11.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:11.804+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:12.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:12.112+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:12.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:12.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:13.135 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:13.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:13.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:13.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:14.130 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:14.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:14.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:14.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:15.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:15.105+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:15.829 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:15.828+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:16.060 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:16.059+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:16.781 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:16.779+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:17.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:17.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:17.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:17.826+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:18.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:18.121+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:18.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:18.839+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:19.167 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:19.164+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:19.838 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:19.836+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:20.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:20.137+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:20.646 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-06T07:26:20.647 INFO:tasks.ceph:Scrubbing osd.1 2023-12-06T07:26:20.648 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-06T07:26:20.842 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:20.840+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:21.173 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:21.171+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:21.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:21.821+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:22.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:22.183+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:22.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:22.854+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:23.149 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:23.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:23.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:23.827+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:24.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:24.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:24.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:24.859+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:25.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:25.066+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:25.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:25.854+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:26.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:26.061+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:26.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:26.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:27.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:27.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:27.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:27.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:28.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:28.032+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:28.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:28.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:29.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:29.070+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:29.866 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:29.864+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:30.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:30.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:30.831 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:30.828+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:31.113 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:31.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:31.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:31.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:32.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:32.071+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:32.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:32.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:33.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:33.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:33.832 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:33.830+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:34.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:34.069+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:34.866 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:34.863+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:35.118 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:35.116+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:35.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:35.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:36.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:36.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:36.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:36.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:37.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:37.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:37.830 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:37.827+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:38.198 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:38.196+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:38.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:38.786+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:39.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:39.243+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:39.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:39.784+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:40.216 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:40.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:40.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:40.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:41.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:41.259+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:41.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:41.882+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:42.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:42.299+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:42.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:42.894+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:43.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:43.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:43.855 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:43.853+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:44.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:44.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:44.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:44.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:45.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:45.313+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:45.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:45.799+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:46.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:46.363+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:46.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:46.824+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:47.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:47.340+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:47.824 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:47.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:48.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:48.361+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:48.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:48.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:49.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:49.411+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:49.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:49.881+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:50.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:50.434+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:50.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:50.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:51.448 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:51.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:51.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:51.906+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:52.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:52.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:52.948 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:52.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:53.517 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:53.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:53.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:53.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:54.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:54.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:54.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:54.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:55.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:55.516+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:55.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:55.923+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:56.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:56.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:56.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:56.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:57.507 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:57.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:57.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:57.924+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:58.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:58.473+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:58.945 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:58.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:59.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:26:59.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:26:59.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:26:59.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:00.425 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:00.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:00.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:00.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:01.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:01.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:01.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:01.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:02.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:02.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:02.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:02.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:03.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:03.471+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:03.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:03.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:04.428 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:04.426+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:04.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:04.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:05.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:05.416+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:05.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:05.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:06.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:06.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:06.886 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:06.885+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:07.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:07.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:07.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:07.888+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:08.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:08.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:08.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:08.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:09.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:09.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:09.833 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:09.831+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:10.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:10.355+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:10.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:10.855+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:11.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:11.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:11.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:11.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:12.384 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:12.382+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:12.828 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:12.825+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:13.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:13.389+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:13.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:13.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:14.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:14.368+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:14.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:14.797+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:15.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:15.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:15.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:15.819+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:16.382 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:16.379+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:16.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:16.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:17.355 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:17.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:17.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:17.876+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:18.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:18.315+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:18.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:18.919+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:19.289 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:19.287+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:19.923 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:19.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:20.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:20.291+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:20.906 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:20.903+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:21.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:21.243+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:21.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:21.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:22.201 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:22.198+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:22.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:22.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:23.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:23.173+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:23.973 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:23.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:24.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:24.137+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:24.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:24.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:25.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:25.093+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:25.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:25.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:26.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:26.065+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:26.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:26.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:27.111 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:27.109+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:27.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:27.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:28.101 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:28.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:28.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:28.969+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:29.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:29.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:29.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:29.994+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:30.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:30.060+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:31.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:31.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:31.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:31.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:32.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:32.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:32.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:32.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:33.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:33.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:33.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:33.085+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:34.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:34.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:34.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:34.086+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:35.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:35.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:35.137 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:35.135+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:36.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:36.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:36.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:36.183+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:37.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:37.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:37.180 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:37.177+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:38.025 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:38.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:38.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:38.179+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:39.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:39.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:39.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:39.134+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:40.059 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:40.056+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:40.184 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:40.182+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:41.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:41.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:41.214 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:41.213+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:42.036 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:42.035+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:42.218 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:42.216+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:43.003 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:43.001+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:43.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:43.182+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:44.004 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:44.002+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:44.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:44.146+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:44.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:44.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:45.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:45.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:46.001 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:45.999+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:46.213 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:46.212+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:47.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:47.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:47.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:47.188+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:48.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:48.014+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:48.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:48.223+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:49.056 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:49.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:49.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:49.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:50.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:50.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:50.253 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:50.252+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:51.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:51.044+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:51.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:51.276+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:52.039 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:52.037+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:52.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:52.231+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:53.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:53.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:53.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:53.241+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:54.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:54.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:54.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:54.214+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:55.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:55.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:55.179 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:55.177+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:56.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:56.167+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:56.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:56.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:57.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:57.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:57.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:57.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:58.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:58.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:58.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:58.233+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:59.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:27:59.038+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:27:59.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:27:59.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:00.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:00.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:00.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:00.163+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:01.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:01.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:01.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:01.136+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:02.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:02.103+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:02.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:02.155+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:03.143 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:03.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:03.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:03.190+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:04.147 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:04.144+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:04.154 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:04.152+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:05.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:05.123+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:05.167 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:05.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:06.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:06.101+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:06.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:06.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:07.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:07.118+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:07.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:07.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:08.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:08.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:08.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:08.209+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:09.053 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:09.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:09.234 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:09.231+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:10.063 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:10.060+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:10.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:10.232+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:11.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:11.053+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:11.220 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:11.217+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:12.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:12.031+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:12.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:12.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:13.078 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:13.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:13.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:13.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:14.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:14.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:14.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:14.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:15.094 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:15.092+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:15.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:15.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:16.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:16.043+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:16.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:16.262+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:17.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:17.053+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:17.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:17.298+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:18.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:18.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:18.257 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:18.254+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:19.048 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:19.045+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:19.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:19.262+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:20.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:19.998+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:20.243 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:20.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:20.720 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-12-06T07:28:20.720 INFO:tasks.ceph:Scrubbing osd.2 2023-12-06T07:28:20.721 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-06T07:28:20.864 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2023-12-06T07:28:20.864 INFO:teuthology.orchestra.run.smithi134.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-06T07:28:20.865 INFO:teuthology.orchestra.run.smithi134.stdout:} 2023-12-06T07:28:20.876 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-06T07:28:21.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:21.022+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:21.190 INFO:teuthology.orchestra.run.smithi134.stderr:instructed osd(s) 2 to deep-scrub 2023-12-06T07:28:21.201 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:28:21.214 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:21.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:21.507 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:28:21.508 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:28:21.519 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5768,"stamp":"2023-12-06T07:28:20.146095+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25096,"ondisk_log_size":25096,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001815"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"155'1381","reported_seq":2447,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.382837+0000","last_change":"2023-12-06T04:25:51.581780+0000","last_active":"2023-12-06T05:24:28.382837+0000","last_peered":"2023-12-06T05:24:28.382837+0000","last_clean":"2023-12-06T05:24:28.382837+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T05:24:28.382837+0000","last_undegraded":"2023-12-06T05:24:28.382837+0000","last_fullsized":"2023-12-06T05:24:28.382837+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1381,"ondisk_log_size":1381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"155'812","reported_seq":1663,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.382881+0000","last_change":"2023-12-06T04:25:51.581723+0000","last_active":"2023-12-06T05:24:28.382881+0000","last_peered":"2023-12-06T05:24:28.382881+0000","last_clean":"2023-12-06T05:24:28.382881+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T05:24:28.382881+0000","last_undegraded":"2023-12-06T05:24:28.382881+0000","last_fullsized":"2023-12-06T05:24:28.382881+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":812,"ondisk_log_size":812,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7896,"ondisk_log_size":7896,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740617,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.22900000000000001,"15min":0.223},"min":{"1min":0.152,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.36699999999999999,"5min":0.47399999999999998,"15min":0.503},"last":0.223},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26700000000000002,"15min":0.26000000000000001},"min":{"1min":0.20599999999999999,"5min":0.19700000000000001,"15min":0.17000000000000001},"max":{"1min":0.35999999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.22900000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:27:30 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.16600000000000001,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.314,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.216},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.26400000000000001,"15min":0.25700000000000001},"min":{"1min":0.185,"5min":0.185,"15min":0.17499999999999999},"max":{"1min":0.33700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25}]}]},{"osd":0,"up_from":8,"seq":34359740618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.20000000000000001,"5min":0.21199999999999999,"15min":0.22700000000000001},"min":{"1min":0.151,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.28100000000000003,"5min":0.36599999999999999,"15min":0.46600000000000003},"last":0.187},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.25900000000000001,"15min":0.26600000000000001},"min":{"1min":0.21199999999999999,"5min":0.184,"15min":0.17499999999999999},"max":{"1min":0.33500000000000002,"5min":0.442,"15min":0.498},"last":0.25700000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.22800000000000001,"15min":0.23599999999999999},"min":{"1min":0.17399999999999999,"5min":0.17000000000000001,"15min":0.14999999999999999},"max":{"1min":0.32000000000000001,"5min":0.40000000000000002,"15min":0.50900000000000001},"last":0.221},{"interface":"front","average":{"1min":0.23400000000000001,"5min":0.23699999999999999,"15min":0.245},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.16900000000000001},"max":{"1min":0.309,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740622,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.20699999999999999,"15min":0.216},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.126},"max":{"1min":0.28799999999999998,"5min":0.36199999999999999,"15min":0.42599999999999999},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.27000000000000002},"min":{"1min":0.187,"5min":0.185,"15min":0.17000000000000001},"max":{"1min":0.35399999999999998,"5min":0.432,"15min":0.504},"last":0.28599999999999998}]},{"osd":2,"last update":"Wed Dec 6 07:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.23300000000000001,"5min":0.22700000000000001,"15min":0.23400000000000001},"min":{"1min":0.19600000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.32300000000000001,"5min":0.38600000000000001,"15min":0.45200000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.25700000000000001,"15min":0.26400000000000001},"min":{"1min":0.222,"5min":0.188,"15min":0.187},"max":{"1min":0.38,"5min":0.41099999999999998,"15min":0.48099999999999998},"last":0.309}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:28:21.524 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.524 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.524 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.524 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.524 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.524 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.525 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.525 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.525 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.525 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.525 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.525 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.526 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:21.526 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:28:22.006 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:22.003+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:22.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:22.219+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:22.961 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:22.958+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:23.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:23.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:24.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:24.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:24.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:24.205+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:25.015 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:25.014+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:25.256 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:25.254+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:25.996 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:25.995+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:26.224 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:26.222+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:26.987 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:26.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:27.202 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:27.201+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:27.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:27.979+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:28.202 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:28.201+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:28.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:28.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:29.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:29.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:29.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:29.981+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:30.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:30.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:30.937 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:30.935+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:31.219 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:31.218+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:31.895 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:31.893+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:32.174 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:32.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:32.864 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:32.862+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:33.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:33.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:33.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:33.832+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:34.223 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:34.221+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:34.821 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:34.819+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:35.212 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:35.210+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:35.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:35.840+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:36.220 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:36.217+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:36.800 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:36.798+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:37.260 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:37.258+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:37.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:37.757+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:38.238 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:38.235+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:38.737 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:38.734+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:39.205 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:39.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:39.785 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:39.782+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:40.217 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:40.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:40.764 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:40.762+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:41.180 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:41.177+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:41.527 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:28:41.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:41.755+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:41.837 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:28:41.839 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:28:41.849 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5778,"stamp":"2023-12-06T07:28:40.149154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25131,"ondisk_log_size":25131,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001945"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7931,"ondisk_log_size":7931,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740621,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.22800000000000001,"15min":0.222},"min":{"1min":0.153,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.503},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.221}]},{"osd":1,"last update":"Wed Dec 6 07:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.17899999999999999,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.45200000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.26500000000000001,"15min":0.25700000000000001},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.17499999999999999},"max":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.20300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740622,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.20000000000000001,"5min":0.21199999999999999,"15min":0.22700000000000001},"min":{"1min":0.151,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.28100000000000003,"5min":0.36599999999999999,"15min":0.46600000000000003},"last":0.14999999999999999},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.25900000000000001,"15min":0.26600000000000001},"min":{"1min":0.21199999999999999,"5min":0.184,"15min":0.17499999999999999},"max":{"1min":0.33500000000000002,"5min":0.442,"15min":0.498},"last":0.20799999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.22800000000000001,"15min":0.23599999999999999},"min":{"1min":0.17399999999999999,"5min":0.17000000000000001,"15min":0.14999999999999999},"max":{"1min":0.32000000000000001,"5min":0.40000000000000002,"15min":0.50900000000000001},"last":0.183},{"interface":"front","average":{"1min":0.23400000000000001,"5min":0.23699999999999999,"15min":0.245},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.16900000000000001},"max":{"1min":0.309,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.24299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740626,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.20699999999999999,"15min":0.216},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.126},"max":{"1min":0.28799999999999998,"5min":0.36199999999999999,"15min":0.42599999999999999},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.27000000000000002},"min":{"1min":0.187,"5min":0.185,"15min":0.17000000000000001},"max":{"1min":0.35399999999999998,"5min":0.432,"15min":0.504},"last":0.23100000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.23300000000000001,"5min":0.22700000000000001,"15min":0.23400000000000001},"min":{"1min":0.19600000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.32300000000000001,"5min":0.38600000000000001,"15min":0.45200000000000001},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.25700000000000001,"15min":0.26400000000000001},"min":{"1min":0.222,"5min":0.188,"15min":0.187},"max":{"1min":0.38,"5min":0.41099999999999998,"15min":0.48099999999999998},"last":0.25900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:28:41.850 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.851 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.851 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.851 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.851 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.851 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.852 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.852 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.852 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.852 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.852 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:28:41.852 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:28:42.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:42.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:42.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:42.756+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:43.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:43.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:43.771 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:43.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:44.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:44.197+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:44.785 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:44.783+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:45.155 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:45.152+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:45.817 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:45.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:46.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:46.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:46.854 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:46.851+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:47.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:47.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:47.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:47.803+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:48.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:48.128+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:48.761 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:48.758+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:49.146 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:49.144+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:49.768 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:49.766+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:50.138 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:50.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:50.724 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:50.722+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:51.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:51.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:51.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:51.745+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:52.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:52.134+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:52.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:52.722+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:53.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:53.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:53.767 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:53.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:54.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:54.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:54.817 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:54.814+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:55.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:55.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:55.783 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:55.780+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:56.230 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:56.228+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:56.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:56.829+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:57.203 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:57.200+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:57.804 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:57.800+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:58.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:58.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:58.829 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:58.826+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:59.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:28:59.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:28:59.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:28:59.831+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:00.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:00.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:00.882 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:00.880+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:01.169 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:01.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:01.853 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:29:01.873 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:01.869+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:29:02.157 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:29:02.168 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5789,"stamp":"2023-12-06T07:29:02.152132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25131,"ondisk_log_size":25131,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001550"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7931,"ondisk_log_size":7931,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740626,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.22800000000000001,"15min":0.222},"min":{"1min":0.153,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.503},"last":0.191},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.26500000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.17899999999999999,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.45200000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.26500000000000001,"15min":0.25700000000000001},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.17499999999999999},"max":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.23400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740627,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.20000000000000001,"5min":0.21199999999999999,"15min":0.22700000000000001},"min":{"1min":0.151,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.28100000000000003,"5min":0.36599999999999999,"15min":0.46600000000000003},"last":0.17399999999999999},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.25900000000000001,"15min":0.26600000000000001},"min":{"1min":0.21199999999999999,"5min":0.184,"15min":0.17499999999999999},"max":{"1min":0.33500000000000002,"5min":0.442,"15min":0.498},"last":0.27000000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:28:10 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.22800000000000001,"15min":0.23599999999999999},"min":{"1min":0.17399999999999999,"5min":0.17000000000000001,"15min":0.14999999999999999},"max":{"1min":0.32000000000000001,"5min":0.40000000000000002,"15min":0.50900000000000001},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.23400000000000001,"5min":0.23699999999999999,"15min":0.245},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.16900000000000001},"max":{"1min":0.309,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.23200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740631,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.20699999999999999,"15min":0.216},"min":{"1min":0.16,"5min":0.13900000000000001,"15min":0.126},"max":{"1min":0.28799999999999998,"5min":0.36199999999999999,"15min":0.42599999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.26000000000000001,"15min":0.27000000000000002},"min":{"1min":0.187,"5min":0.185,"15min":0.17000000000000001},"max":{"1min":0.35399999999999998,"5min":0.432,"15min":0.504},"last":0.40899999999999997}]},{"osd":2,"last update":"Wed Dec 6 07:28:11 2023","interfaces":[{"interface":"back","average":{"1min":0.23300000000000001,"5min":0.22700000000000001,"15min":0.23400000000000001},"min":{"1min":0.19600000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.32300000000000001,"5min":0.38600000000000001,"15min":0.45200000000000001},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.25700000000000001,"15min":0.26400000000000001},"min":{"1min":0.222,"5min":0.188,"15min":0.187},"max":{"1min":0.38,"5min":0.41099999999999998,"15min":0.48099999999999998},"last":0.38600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:29:02.169 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.170 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.170 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.170 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.170 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.170 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.170 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.171 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.171 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.171 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.171 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:02.171 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:29:02.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:02.203+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:02.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:02.891+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:03.250 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:03.243+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:03.872 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:03.870+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:04.240 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:04.238+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:04.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:04.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:05.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:05.259+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:05.799 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:05.795+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:06.265 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:06.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:06.794 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:06.792+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:07.235 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:07.233+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:07.841 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:07.839+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:08.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:08.240+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:08.887 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:08.886+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:09.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:09.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:09.864 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:09.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:10.163 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:10.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:10.869 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:10.867+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:11.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:11.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:11.877 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:11.876+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:12.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:12.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:12.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:12.884+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:13.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:13.112+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:13.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:13.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:14.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:14.080+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:14.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:14.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:15.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:15.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:15.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:15.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:16.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:16.059+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:16.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:16.906+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:17.038 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:17.036+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:17.934 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:17.932+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:18.006 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:18.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:18.921 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:18.918+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:18.994 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:18.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:19.886 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:19.883+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:20.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:20.009+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:20.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:20.899+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:21.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:21.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:21.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:21.852+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:22.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:22.031+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:22.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:29:22.471 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:29:22.473 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:29:22.484 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5799,"stamp":"2023-12-06T07:29:22.155278+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25131,"ondisk_log_size":25131,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001619"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7931,"ondisk_log_size":7931,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740630,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.22800000000000001,"15min":0.222},"min":{"1min":0.153,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.501,"5min":0.501,"15min":0.503},"last":0.184},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26800000000000002,"15min":0.26000000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.50900000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.23899999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:28:34 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.17899999999999999,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.45200000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.224},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.26500000000000001,"15min":0.25700000000000001},"min":{"1min":0.20200000000000001,"5min":0.185,"15min":0.17499999999999999},"max":{"1min":0.48999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.253}]}]},{"osd":0,"up_from":8,"seq":34359740631,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.187,"5min":0.20399999999999999,"15min":0.223},"min":{"1min":0.14999999999999999,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.255,"5min":0.36099999999999999,"15min":0.46600000000000003},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.25800000000000001,"15min":0.26600000000000001},"min":{"1min":0.20399999999999999,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.317,"5min":0.372,"15min":0.498},"last":0.28599999999999998}]},{"osd":2,"last update":"Wed Dec 6 07:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.22500000000000001,"15min":0.23400000000000001},"min":{"1min":0.183,"5min":0.17000000000000001,"15min":0.14999999999999999},"max":{"1min":0.29399999999999998,"5min":0.39800000000000002,"15min":0.50900000000000001},"last":0.246},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.23599999999999999,"15min":0.24399999999999999},"min":{"1min":0.20399999999999999,"5min":0.17699999999999999,"15min":0.16900000000000001},"max":{"1min":0.29399999999999998,"5min":0.40500000000000003,"15min":0.45700000000000002},"last":0.254}]}]},{"osd":1,"up_from":8,"seq":34359740635,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.216},"min":{"1min":0.14999999999999999,"5min":0.13900000000000001,"15min":0.13300000000000001},"max":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.187},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.27100000000000002},"min":{"1min":0.216,"5min":0.185,"15min":0.17000000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.504},"last":0.27300000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"min":{"1min":0.19500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.26700000000000002,"15min":0.26500000000000001},"min":{"1min":0.223,"5min":0.188,"15min":0.187},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.29599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:29:22.487 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.487 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.487 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.488 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.488 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.488 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.488 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.488 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.488 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.489 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.489 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:22.489 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:29:22.846 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:22.843+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:23.071 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:23.069+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:23.881 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:23.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:24.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:24.067+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:24.893 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:24.891+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:25.084 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:25.082+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:25.871 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:25.869+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:26.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:26.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:26.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:26.845+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:27.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:27.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:27.812 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:27.809+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:28.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:28.069+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:28.785 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:28.782+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:29.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:29.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:29.748 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:29.745+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:30.007 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:30.005+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:30.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:30.699+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:30.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:30.975+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:31.735 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:31.732+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:31.966 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:31.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:32.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:32.771+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:32.944 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:32.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:33.729 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:33.727+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:33.920 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:33.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:34.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:34.759+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:34.964 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:34.961+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:35.784 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:35.781+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:35.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:35.937+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:36.759 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:36.756+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:36.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:36.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:37.779 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:37.777+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:37.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:37.986+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:38.811 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:38.809+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:38.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:38.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:39.767 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:39.763+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:39.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:39.950+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:40.767 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:40.765+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:40.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:40.956+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:41.782 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:41.779+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:41.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:41.955+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:42.490 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:29:42.747 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:42.745+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:42.783 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:29:42.785 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:29:42.796 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5809,"stamp":"2023-12-06T07:29:42.158154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25131,"ondisk_log_size":25131,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001828"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7931,"ondisk_log_size":7931,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740634,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.222,"15min":0.221},"min":{"1min":0.14199999999999999,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.36799999999999999,"5min":0.501,"15min":0.501},"last":0.17499999999999999},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.25900000000000001},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.39700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.24099999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.22900000000000001,"5min":0.23000000000000001,"15min":0.22500000000000001},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.40500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.26100000000000001,"15min":0.25600000000000001},"min":{"1min":0.20100000000000001,"5min":0.185,"15min":0.17499999999999999},"max":{"1min":0.38500000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.22600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740635,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.187,"5min":0.20399999999999999,"15min":0.223},"min":{"1min":0.14999999999999999,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.255,"5min":0.36099999999999999,"15min":0.46600000000000003},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.25800000000000001,"15min":0.26600000000000001},"min":{"1min":0.20399999999999999,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.317,"5min":0.372,"15min":0.498},"last":0.26500000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.22500000000000001,"15min":0.23400000000000001},"min":{"1min":0.183,"5min":0.17000000000000001,"15min":0.14999999999999999},"max":{"1min":0.29399999999999998,"5min":0.39800000000000002,"15min":0.50900000000000001},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.23599999999999999,"15min":0.24399999999999999},"min":{"1min":0.20399999999999999,"5min":0.17699999999999999,"15min":0.16900000000000001},"max":{"1min":0.29399999999999998,"5min":0.40500000000000003,"15min":0.45700000000000002},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740639,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.216},"min":{"1min":0.14999999999999999,"5min":0.13900000000000001,"15min":0.13300000000000001},"max":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.17499999999999999},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.27100000000000002},"min":{"1min":0.216,"5min":0.185,"15min":0.17000000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.504},"last":0.26200000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"min":{"1min":0.19500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.26700000000000002,"15min":0.26500000000000001},"min":{"1min":0.223,"5min":0.188,"15min":0.187},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.29099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:29:42.797 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.798 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.798 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.798 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.798 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.798 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.799 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.799 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.799 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.799 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.799 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:29:42.799 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:29:42.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:42.922+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:43.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:43.729+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:43.908 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:43.904+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:44.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:44.683+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:44.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:44.933+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:45.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:45.635+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:45.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:45.974+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:46.666 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:46.664+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:47.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:47.015+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:47.622 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:47.619+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:48.015 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:48.012+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:48.599 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:48.596+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:49.000 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:48.997+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:49.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:49.602+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:50.020 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:50.018+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:50.617 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:50.616+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:51.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:51.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:51.653 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:51.652+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:51.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:51.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:52.703 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:52.702+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:52.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:52.981+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:53.693 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:53.692+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:53.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:53.991+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:54.705 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:54.704+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:54.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:54.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:55.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:55.723+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:56.008 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:56.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:56.692 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:56.687+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:56.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:56.971+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:57.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:57.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:57.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:57.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:58.689 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:58.688+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:58.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:29:58.969+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:29:59.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:29:59.689+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:00.012 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:00.010+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:00.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:00.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:00.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:00.963+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:01.655 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:01.654+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:02.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:02.006+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:02.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:02.695+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:02.800 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:30:03.057 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:03.052+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:03.094 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:30:03.097 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:30:03.107 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5819,"stamp":"2023-12-06T07:30:02.161393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25131,"ondisk_log_size":25131,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001945"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7931,"ondisk_log_size":7931,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740638,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.222,"15min":0.221},"min":{"1min":0.14199999999999999,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.36799999999999999,"5min":0.501,"15min":0.501},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.25900000000000001},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.39700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.26900000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.22900000000000001,"5min":0.23000000000000001,"15min":0.22500000000000001},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.40500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.26100000000000001,"15min":0.25600000000000001},"min":{"1min":0.20100000000000001,"5min":0.185,"15min":0.17499999999999999},"max":{"1min":0.38500000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.23999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740639,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.187,"5min":0.20399999999999999,"15min":0.223},"min":{"1min":0.14999999999999999,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.255,"5min":0.36099999999999999,"15min":0.46600000000000003},"last":0.16800000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.25800000000000001,"15min":0.26600000000000001},"min":{"1min":0.20399999999999999,"5min":0.184,"15min":0.17799999999999999},"max":{"1min":0.317,"5min":0.372,"15min":0.498},"last":0.23300000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:29:10 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.22500000000000001,"15min":0.23400000000000001},"min":{"1min":0.183,"5min":0.17000000000000001,"15min":0.14999999999999999},"max":{"1min":0.29399999999999998,"5min":0.39800000000000002,"15min":0.50900000000000001},"last":0.221},{"interface":"front","average":{"1min":0.23699999999999999,"5min":0.23599999999999999,"15min":0.24399999999999999},"min":{"1min":0.20399999999999999,"5min":0.17699999999999999,"15min":0.16900000000000001},"max":{"1min":0.29399999999999998,"5min":0.40500000000000003,"15min":0.45700000000000002},"last":0.20200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740643,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.22700000000000001,"5min":0.21099999999999999,"15min":0.216},"min":{"1min":0.14999999999999999,"5min":0.13900000000000001,"15min":0.13300000000000001},"max":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.27100000000000002},"min":{"1min":0.216,"5min":0.185,"15min":0.17000000000000001},"max":{"1min":0.442,"5min":0.442,"15min":0.504},"last":0.23599999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:29:14 2023","interfaces":[{"interface":"back","average":{"1min":0.27100000000000002,"5min":0.23499999999999999,"15min":0.23499999999999999},"min":{"1min":0.19500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.26700000000000002,"15min":0.26500000000000001},"min":{"1min":0.223,"5min":0.188,"15min":0.187},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.25800000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:30:03.108 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.109 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.109 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.109 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.109 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.109 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.109 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.110 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.110 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.110 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.110 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:03.110 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:30:03.727 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:03.724+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:04.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:04.026+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:04.750 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:04.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:05.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:04.999+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:05.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:05.789+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:06.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:06.021+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:06.750 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:06.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:06.989 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:06.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:07.738 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:07.735+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:07.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:07.956+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:08.787 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:08.785+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:08.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:08.921+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:09.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:09.805+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:09.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:09.956+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:10.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:10.830+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:10.979 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:10.977+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:11.817 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:11.815+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:12.018 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:12.016+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:12.808 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:12.806+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:13.024 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:13.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:13.761 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:13.759+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:14.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:14.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:14.801 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:14.798+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:15.044 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:15.041+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:15.791 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:15.789+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:16.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:16.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:16.783 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:16.781+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:17.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:17.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:17.827 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:17.824+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:18.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:18.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:18.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:18.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:19.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:19.131+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:19.884 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:19.882+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:20.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:20.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:20.929 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:20.927+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:21.153 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:21.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:21.946 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:21.943+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:22.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:22.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:22.989 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:22.986+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:23.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:30:23.139 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:23.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:23.412 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:30:23.414 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:30:23.427 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5829,"stamp":"2023-12-06T07:30:22.164626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25131,"ondisk_log_size":25131,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002133"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7931,"ondisk_log_size":7931,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740642,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.222,"15min":0.221},"min":{"1min":0.14199999999999999,"5min":0.14000000000000001,"15min":0.14000000000000001},"max":{"1min":0.36799999999999999,"5min":0.501,"15min":0.501},"last":0.19700000000000001},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.25900000000000001},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.17000000000000001},"max":{"1min":0.39700000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.26300000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.22900000000000001,"5min":0.23000000000000001,"15min":0.22500000000000001},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.154},"max":{"1min":0.40500000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.215},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.26100000000000001,"15min":0.25600000000000001},"min":{"1min":0.20100000000000001,"5min":0.185,"15min":0.17499999999999999},"max":{"1min":0.38500000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.245}]}]},{"osd":0,"up_from":8,"seq":34359740643,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.20200000000000001,"15min":0.22},"min":{"1min":0.13800000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.35999999999999999,"5min":0.36099999999999999,"15min":0.46600000000000003},"last":0.17799999999999999},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.26000000000000001,"15min":0.26500000000000001},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.18099999999999999},"max":{"1min":0.441,"5min":0.441,"15min":0.498},"last":0.22900000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.224,"15min":0.23200000000000001},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.14999999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.50900000000000001},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.24299999999999999},"min":{"1min":0.19600000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.20899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740647,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:30:18 2023","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.21199999999999999,"15min":0.216},"min":{"1min":0.159,"5min":0.13900000000000001,"15min":0.13300000000000001},"max":{"1min":0.35499999999999998,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.16600000000000001},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26900000000000002,"15min":0.27100000000000002},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":0.40400000000000003,"5min":0.442,"15min":0.504},"last":0.25800000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:30:18 2023","interfaces":[{"interface":"back","average":{"1min":0.22600000000000001,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.185,"5min":0.17599999999999999,"15min":0.16500000000000001},"max":{"1min":0.34399999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.26900000000000002,"15min":0.26500000000000001},"min":{"1min":0.22,"5min":0.19900000000000001,"15min":0.187},"max":{"1min":0.377,"5min":0.499,"15min":0.499},"last":0.23100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:30:23.428 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.428 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.428 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.428 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.429 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.429 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.429 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.429 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.429 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.429 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.430 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:23.430 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:30:23.983 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:23.981+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:24.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:24.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:24.960 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:24.957+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:25.163 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:25.161+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:25.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:25.967+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:26.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:26.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:27.014 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:27.011+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:27.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:27.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:28.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:28.040+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:28.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:28.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:29.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:29.018+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:29.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:29.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:29.990 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:29.987+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:30.149 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:30.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:30.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:30.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:31.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:31.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:32.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:32.016+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:32.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:32.063+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:33.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:33.063+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:33.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:33.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:34.027 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:34.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:34.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:34.101+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:35.065 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:35.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:35.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:35.075+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:36.021 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:36.019+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:36.079 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:36.069+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:37.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:37.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:37.063 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:37.062+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:38.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:38.055+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:38.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:38.091+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:39.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:39.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:39.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:39.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:40.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:40.033+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:40.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:40.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:41.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:41.036+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:41.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:41.134+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:42.040 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:42.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:42.178 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:42.177+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:43.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:43.000+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:43.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:43.225+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:43.430 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:30:43.742 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:30:43.744 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:30:43.755 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5839,"stamp":"2023-12-06T07:30:42.167824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25131,"ondisk_log_size":25131,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001994"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"155'2635","reported_seq":6590,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054530+0000","last_change":"2023-12-06T04:25:51.595590+0000","last_active":"2023-12-06T05:24:28.054530+0000","last_peered":"2023-12-06T05:24:28.054530+0000","last_clean":"2023-12-06T05:24:28.054530+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T05:24:28.054530+0000","last_undegraded":"2023-12-06T05:24:28.054530+0000","last_fullsized":"2023-12-06T05:24:28.054530+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":2635,"ondisk_log_size":2635,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":154,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054657+0000","last_change":"2023-12-06T04:21:17.544942+0000","last_active":"2023-12-06T05:24:28.054657+0000","last_peered":"2023-12-06T05:24:28.054657+0000","last_clean":"2023-12-06T05:24:28.054657+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T05:24:28.054657+0000","last_undegraded":"2023-12-06T05:24:28.054657+0000","last_fullsized":"2023-12-06T05:24:28.054657+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"154'1276","reported_seq":2201,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054608+0000","last_change":"2023-12-06T04:25:51.584628+0000","last_active":"2023-12-06T05:24:28.054608+0000","last_peered":"2023-12-06T05:24:28.054608+0000","last_clean":"2023-12-06T05:24:28.054608+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T05:24:28.054608+0000","last_undegraded":"2023-12-06T05:24:28.054608+0000","last_fullsized":"2023-12-06T05:24:28.054608+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1276,"ondisk_log_size":1276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"155'5478","reported_seq":13197,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054667+0000","last_change":"2023-12-06T04:25:51.596930+0000","last_active":"2023-12-06T05:24:28.054667+0000","last_peered":"2023-12-06T05:24:28.054667+0000","last_clean":"2023-12-06T05:24:28.054667+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T05:24:28.054667+0000","last_undegraded":"2023-12-06T05:24:28.054667+0000","last_fullsized":"2023-12-06T05:24:28.054667+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5478,"ondisk_log_size":5478,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"155'849","reported_seq":2022,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054565+0000","last_change":"2023-12-06T04:25:51.594906+0000","last_active":"2023-12-06T05:24:28.054565+0000","last_peered":"2023-12-06T05:24:28.054565+0000","last_clean":"2023-12-06T05:24:28.054565+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T05:24:28.054565+0000","last_undegraded":"2023-12-06T05:24:28.054565+0000","last_fullsized":"2023-12-06T05:24:28.054565+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":849,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1950,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054942+0000","last_change":"2023-12-06T04:25:51.584379+0000","last_active":"2023-12-06T05:24:28.054942+0000","last_peered":"2023-12-06T05:24:28.054942+0000","last_clean":"2023-12-06T05:24:28.054942+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T05:24:28.054942+0000","last_undegraded":"2023-12-06T05:24:28.054942+0000","last_fullsized":"2023-12-06T05:24:28.054942+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17200,"ondisk_log_size":17200,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7931,"ondisk_log_size":7931,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740646,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:30:40 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.219,"15min":0.221},"min":{"1min":0.13700000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.36199999999999999,"5min":0.501,"15min":0.501},"last":0.17199999999999999},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26300000000000001,"15min":0.26000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":0.38600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.23799999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:30:40 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.154},"max":{"1min":0.34200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.247,"5min":0.25700000000000001,"15min":0.25600000000000001},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.372,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740647,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.20200000000000001,"15min":0.22},"min":{"1min":0.13800000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.35999999999999999,"5min":0.36099999999999999,"15min":0.46600000000000003},"last":0.156},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.26000000000000001,"15min":0.26500000000000001},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.18099999999999999},"max":{"1min":0.441,"5min":0.441,"15min":0.498},"last":0.309}]},{"osd":2,"last update":"Wed Dec 6 07:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.224,"15min":0.23200000000000001},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.14999999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.50900000000000001},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.24299999999999999},"min":{"1min":0.19600000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.245}]}]},{"osd":1,"up_from":8,"seq":34359740651,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:30:18 2023","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.21199999999999999,"15min":0.216},"min":{"1min":0.159,"5min":0.13900000000000001,"15min":0.13300000000000001},"max":{"1min":0.35499999999999998,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.185},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26900000000000002,"15min":0.27100000000000002},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":0.40400000000000003,"5min":0.442,"15min":0.504},"last":0.255}]},{"osd":2,"last update":"Wed Dec 6 07:30:18 2023","interfaces":[{"interface":"back","average":{"1min":0.22600000000000001,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.185,"5min":0.17599999999999999,"15min":0.16500000000000001},"max":{"1min":0.34399999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.26900000000000002,"15min":0.26500000000000001},"min":{"1min":0.22,"5min":0.19900000000000001,"15min":0.187},"max":{"1min":0.377,"5min":0.499,"15min":0.499},"last":0.23300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:30:43.756 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.756 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.757 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.757 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.757 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.757 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.757 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.757 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.758 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.758 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.758 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:30:43.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-12-06T07:30:44.017 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:44.016+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:44.098 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-12-06T07:30:44.114 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-12-06T07:30:44.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:44.253+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:44.410 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-12-06T07:30:44.421 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-12-06T07:30:44.715 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-12-06T07:30:44.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-12-06T07:30:45.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:45.055+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:45.260 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:45.258+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:45.851 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-12-06T07:30:45.865 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-12-06T07:30:46.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:46.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:46.169 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-12-06T07:30:46.180 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-12-06T07:30:46.233 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:46.231+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:46.509 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-12-06T07:30:46.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-12-06T07:30:46.818 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-12-06T07:30:46.830 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-12-06T07:30:47.004 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:47.002+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:47.125 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-12-06T07:30:47.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-12-06T07:30:47.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:47.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:47.427 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-12-06T07:30:47.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-12-06T07:30:47.730 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-12-06T07:30:47.741 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-12-06T07:30:48.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:48.008+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:48.035 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-12-06T07:30:48.045 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:30:48.233 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:48.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:48.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:48.964+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:49.184 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:49.182+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:49.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:49.952+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:50.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:50.145+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:50.958 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:50.956+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:51.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:51.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:51.995 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:51.992+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:52.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:52.092+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:53.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:53.019+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:53.050 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:53.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:53.988 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:53.985+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:54.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:54.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:54.991 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:54.989+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:55.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:55.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:56.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:56.035+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:56.119 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:56.117+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:57.012 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:57.009+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:57.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:57.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:58.053 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:58.050+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:58.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:58.115+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:59.037 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:30:59.033+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:30:59.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:30:59.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:00.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:00.045+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:00.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:00.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:01.071 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:01.069+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:01.138 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:01.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:02.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:02.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:02.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:02.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:03.097 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:03.095+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:03.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:03.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:04.132 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:04.129+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:04.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:04.184+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:05.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:05.119+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:05.141 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:05.137+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:06.091 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:06.089+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:06.116 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:06.114+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:07.051 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:07.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:07.092 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:07.089+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:08.047 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:31:08.076 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:08.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:08.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:08.083+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:08.341 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:31:08.343 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:31:08.354 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5852,"stamp":"2023-12-06T07:31:08.171453+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001581"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740651,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:30:40 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.219,"15min":0.221},"min":{"1min":0.13700000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.36199999999999999,"5min":0.501,"15min":0.501},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26300000000000001,"15min":0.26000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":0.38600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.26500000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:30:40 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.154},"max":{"1min":0.34200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.247,"5min":0.25700000000000001,"15min":0.25600000000000001},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.372,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.27800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740652,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.20200000000000001,"15min":0.22},"min":{"1min":0.13800000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.35999999999999999,"5min":0.36099999999999999,"15min":0.46600000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.26000000000000001,"15min":0.26500000000000001},"min":{"1min":0.20999999999999999,"5min":0.193,"15min":0.18099999999999999},"max":{"1min":0.441,"5min":0.441,"15min":0.498},"last":0.26400000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:30:11 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.224,"15min":0.23200000000000001},"min":{"1min":0.16700000000000001,"5min":0.16700000000000001,"15min":0.14999999999999999},"max":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.50900000000000001},"last":0.222},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.24299999999999999},"min":{"1min":0.19600000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.25}]}]},{"osd":1,"up_from":8,"seq":34359740656,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:30:18 2023","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.21199999999999999,"15min":0.216},"min":{"1min":0.159,"5min":0.13900000000000001,"15min":0.13300000000000001},"max":{"1min":0.35499999999999998,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.183},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26900000000000002,"15min":0.27100000000000002},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":0.40400000000000003,"5min":0.442,"15min":0.504},"last":0.252}]},{"osd":2,"last update":"Wed Dec 6 07:30:18 2023","interfaces":[{"interface":"back","average":{"1min":0.22600000000000001,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.185,"5min":0.17599999999999999,"15min":0.16500000000000001},"max":{"1min":0.34399999999999997,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.26900000000000002,"15min":0.26500000000000001},"min":{"1min":0.22,"5min":0.19900000000000001,"15min":0.187},"max":{"1min":0.377,"5min":0.499,"15min":0.499},"last":0.27900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:31:08.355 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:08.355 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:08.355 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:08.356 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:08.356 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:08.356 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:08.356 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:31:09.047 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:09.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:09.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:09.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:10.029 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:10.026+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:10.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:10.098+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:11.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:11.033+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:11.115 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:11.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:12.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:12.053+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:12.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:12.127+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:13.009 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:13.007+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:13.122 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:13.120+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:14.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:14.032+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:14.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:14.122+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:15.044 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:15.042+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:15.092 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:15.090+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:16.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:16.066+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:16.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:16.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:17.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:17.037+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:17.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:17.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:18.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:18.025+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:18.177 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:18.176+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:18.980 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:18.979+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:19.130 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:19.128+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:19.954 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:19.953+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:20.171 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:20.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:20.940 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:20.939+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:21.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:21.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:21.926 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:21.925+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:22.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:22.199+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:22.939 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:22.937+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:23.178 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:23.177+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:23.921 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:23.920+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:24.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:24.153+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:24.956 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:24.954+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:25.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:25.163+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:25.973 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:25.971+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:26.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:26.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:26.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:26.946+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:27.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:27.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:27.898 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:27.897+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:28.232 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:28.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:28.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:31:28.691 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:31:28.693 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:31:28.705 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5862,"stamp":"2023-12-06T07:31:28.174286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001765"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740655,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:30:40 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.219,"15min":0.221},"min":{"1min":0.13700000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.36199999999999999,"5min":0.501,"15min":0.501},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26300000000000001,"15min":0.26000000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":0.38600000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.27600000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:30:40 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.16200000000000001,"5min":0.16200000000000001,"15min":0.154},"max":{"1min":0.34200000000000003,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.247,"5min":0.25700000000000001,"15min":0.25600000000000001},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.372,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.26500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740656,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.20200000000000001,"15min":0.221},"min":{"1min":0.156,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.17199999999999999},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.26500000000000001,"15min":0.26900000000000002},"min":{"1min":0.222,"5min":0.20399999999999999,"15min":0.18099999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.248}]},{"osd":2,"last update":"Wed Dec 6 07:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.22500000000000001,"15min":0.23400000000000001},"min":{"1min":0.20000000000000001,"5min":0.16700000000000001,"15min":0.14999999999999999},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.24399999999999999},"min":{"1min":0.19600000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.33200000000000002,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.216}]}]},{"osd":1,"up_from":8,"seq":34359740660,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:31:19 2023","interfaces":[{"interface":"back","average":{"1min":0.193,"5min":0.20899999999999999,"15min":0.215},"min":{"1min":0.13,"5min":0.13,"15min":0.13},"max":{"1min":0.27600000000000002,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.27100000000000002,"15min":0.27200000000000002},"min":{"1min":0.20100000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":0.37,"5min":0.442,"15min":0.504},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:31:19 2023","interfaces":[{"interface":"back","average":{"1min":0.22900000000000001,"5min":0.23799999999999999,"15min":0.23599999999999999},"min":{"1min":0.17699999999999999,"5min":0.17599999999999999,"15min":0.16500000000000001},"max":{"1min":0.31,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27200000000000002,"15min":0.26700000000000002},"min":{"1min":0.20699999999999999,"5min":0.19900000000000001,"15min":0.187},"max":{"1min":0.35399999999999998,"5min":0.499,"15min":0.499},"last":0.36799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:31:28.706 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:28.706 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:28.707 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:28.707 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:28.707 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:28.707 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:28.707 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:31:28.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:28.895+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:29.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:29.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:29.902 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:29.900+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:30.295 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:30.293+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:30.883 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:30.881+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:31.298 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:31.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:31.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:31.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:32.332 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:32.329+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:32.909 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:32.907+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:33.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:33.334+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:33.914 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:33.911+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:34.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:34.361+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:34.879 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:34.877+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:35.394 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:35.391+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:35.896 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:35.894+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:36.348 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:36.346+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:36.922 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:36.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:37.350 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:37.344+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:37.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:37.965+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:38.333 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:38.331+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:38.933 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:38.931+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:39.378 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:39.376+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:39.921 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:39.919+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:40.364 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:40.362+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:40.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:40.963+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:41.400 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:41.398+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:41.928 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:41.926+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:42.404 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:42.402+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:42.974 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:42.972+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:43.361 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:43.358+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:43.977 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:43.974+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:44.352 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:44.350+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:44.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:44.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:45.327 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:45.325+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:46.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:46.008+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:46.366 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:46.364+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:46.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:46.966+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:47.367 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:47.364+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:48.016 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:48.013+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:48.381 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:48.378+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:48.709 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:31:49.010 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:31:49.012 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:31:49.023 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5872,"stamp":"2023-12-06T07:31:48.177109+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001693"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740659,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:31:41 2023","interfaces":[{"interface":"back","average":{"1min":0.20100000000000001,"5min":0.21199999999999999,"15min":0.219},"min":{"1min":0.156,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.316,"5min":0.501,"15min":0.501},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26000000000000001,"15min":0.25900000000000001},"min":{"1min":0.219,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":0.38700000000000001,"5min":0.50900000000000001,"15min":0.51400000000000001},"last":0.24399999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:31:41 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.182,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.38300000000000001,"5min":0.45200000000000001,"15min":0.47099999999999997},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.255,"15min":0.25600000000000001},"min":{"1min":0.20699999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.40500000000000003,"5min":0.48999999999999999,"15min":0.50600000000000001},"last":0.25600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740660,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.20200000000000001,"15min":0.221},"min":{"1min":0.156,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.26500000000000001,"15min":0.26900000000000002},"min":{"1min":0.222,"5min":0.20399999999999999,"15min":0.18099999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.28899999999999998}]},{"osd":2,"last update":"Wed Dec 6 07:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.22500000000000001,"15min":0.23400000000000001},"min":{"1min":0.20000000000000001,"5min":0.16700000000000001,"15min":0.14999999999999999},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.253},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.24399999999999999},"min":{"1min":0.19600000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.33200000000000002,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.26600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740665,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:31:19 2023","interfaces":[{"interface":"back","average":{"1min":0.193,"5min":0.20899999999999999,"15min":0.215},"min":{"1min":0.13,"5min":0.13,"15min":0.13},"max":{"1min":0.27600000000000002,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.19500000000000001},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.27100000000000002,"15min":0.27200000000000002},"min":{"1min":0.20100000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":0.37,"5min":0.442,"15min":0.504},"last":0.22700000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:31:19 2023","interfaces":[{"interface":"back","average":{"1min":0.22900000000000001,"5min":0.23799999999999999,"15min":0.23599999999999999},"min":{"1min":0.17699999999999999,"5min":0.17599999999999999,"15min":0.16500000000000001},"max":{"1min":0.31,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27200000000000002,"15min":0.26700000000000002},"min":{"1min":0.20699999999999999,"5min":0.19900000000000001,"15min":0.187},"max":{"1min":0.35399999999999998,"5min":0.499,"15min":0.499},"last":0.248}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:31:49.024 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:49.024 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:49.024 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:49.025 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:49.025 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:49.025 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:31:49.025 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:31:49.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:49.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:49.359 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:49.356+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:50.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:50.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:50.316 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:50.314+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:51.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:51.031+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:51.299 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:51.297+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:52.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:52.062+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:52.278 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:52.275+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:53.051 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:53.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:53.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:53.239+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:54.032 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:54.030+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:54.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:54.191+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:55.080 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:55.077+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:55.161 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:55.159+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:56.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:56.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:56.201 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:56.199+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:57.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:57.094+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:57.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:57.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:58.100 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:58.098+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:58.178 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:58.176+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:59.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:31:59.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:31:59.148 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:31:59.147+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:00.059 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:00.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:00.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:00.197+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:01.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:01.069+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:01.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:01.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:02.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:02.044+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:02.261 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:02.260+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:03.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:03.081+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:03.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:03.227+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:04.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:04.038+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:04.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:04.251+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:05.007 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:05.006+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:05.292 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:05.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:06.050 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:06.049+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:06.322 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:06.321+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:07.073 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:07.072+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:07.356 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:07.355+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:08.081 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:08.080+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:08.368 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:08.367+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:09.027 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:32:09.125 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:09.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:09.324 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:32:09.325 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:32:09.338 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5882,"stamp":"2023-12-06T07:32:08.180179+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001872"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740663,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:31:41 2023","interfaces":[{"interface":"back","average":{"1min":0.20100000000000001,"5min":0.21199999999999999,"15min":0.219},"min":{"1min":0.156,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.316,"5min":0.501,"15min":0.501},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26000000000000001,"15min":0.25900000000000001},"min":{"1min":0.219,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":0.38700000000000001,"5min":0.50900000000000001,"15min":0.51400000000000001},"last":0.214}]},{"osd":1,"last update":"Wed Dec 6 07:31:41 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.182,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.38300000000000001,"5min":0.45200000000000001,"15min":0.47099999999999997},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.255,"15min":0.25600000000000001},"min":{"1min":0.20699999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.40500000000000003,"5min":0.48999999999999999,"15min":0.50600000000000001},"last":0.23599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740664,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.20200000000000001,"15min":0.221},"min":{"1min":0.156,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.14000000000000001},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.26500000000000001,"15min":0.26900000000000002},"min":{"1min":0.222,"5min":0.20399999999999999,"15min":0.18099999999999999},"max":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.19400000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:31:11 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.22500000000000001,"15min":0.23400000000000001},"min":{"1min":0.20000000000000001,"5min":0.16700000000000001,"15min":0.14999999999999999},"max":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.159},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.23499999999999999,"15min":0.24399999999999999},"min":{"1min":0.19600000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.33200000000000002,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.182}]}]},{"osd":1,"up_from":8,"seq":34359740669,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:31:19 2023","interfaces":[{"interface":"back","average":{"1min":0.193,"5min":0.20899999999999999,"15min":0.215},"min":{"1min":0.13,"5min":0.13,"15min":0.13},"max":{"1min":0.27600000000000002,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.27100000000000002,"15min":0.27200000000000002},"min":{"1min":0.20100000000000001,"5min":0.17799999999999999,"15min":0.17000000000000001},"max":{"1min":0.37,"5min":0.442,"15min":0.504},"last":0.23999999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:31:19 2023","interfaces":[{"interface":"back","average":{"1min":0.22900000000000001,"5min":0.23799999999999999,"15min":0.23599999999999999},"min":{"1min":0.17699999999999999,"5min":0.17599999999999999,"15min":0.16500000000000001},"max":{"1min":0.31,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.217},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27200000000000002,"15min":0.26700000000000002},"min":{"1min":0.20699999999999999,"5min":0.19900000000000001,"15min":0.187},"max":{"1min":0.35399999999999998,"5min":0.499,"15min":0.499},"last":0.26000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:32:09.339 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:09.339 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:09.339 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:09.340 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:09.340 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:09.340 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:09.341 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:32:09.371 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:09.370+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:10.136 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:10.135+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:10.387 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:10.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:11.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:11.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:11.433 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:11.431+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:12.090 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:12.088+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:12.480 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:12.477+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:13.095 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:13.091+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:13.519 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:13.517+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:14.099 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:14.097+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:14.492 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:14.490+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:15.076 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:15.074+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:15.459 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:15.457+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:16.109 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:16.107+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:16.424 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:16.422+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:17.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:17.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:17.412 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:17.410+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:18.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:18.103+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:18.369 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:18.367+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:19.108 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:19.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:19.343 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:19.341+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:20.068 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:20.064+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:20.389 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:20.386+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:21.075 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:21.073+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:21.428 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:21.426+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:22.122 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:22.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:22.379 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:22.377+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:23.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:23.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:23.346 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:23.344+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:24.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:24.208+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:24.302 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:24.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:25.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:25.217+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:25.279 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:25.277+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:26.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:26.215+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:26.280 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:26.278+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:27.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:27.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:27.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:27.260+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:28.227 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:28.225+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:28.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:28.247+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:29.206 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:29.204+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:29.234 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:29.232+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:29.342 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:32:29.638 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:32:29.640 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:32:29.652 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5892,"stamp":"2023-12-06T07:32:28.183272+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001950"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740667,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:31:41 2023","interfaces":[{"interface":"back","average":{"1min":0.20100000000000001,"5min":0.21199999999999999,"15min":0.219},"min":{"1min":0.156,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.316,"5min":0.501,"15min":0.501},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26000000000000001,"15min":0.25900000000000001},"min":{"1min":0.219,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":0.38700000000000001,"5min":0.50900000000000001,"15min":0.51400000000000001},"last":0.28699999999999998}]},{"osd":1,"last update":"Wed Dec 6 07:31:41 2023","interfaces":[{"interface":"back","average":{"1min":0.223,"5min":0.22500000000000001,"15min":0.22500000000000001},"min":{"1min":0.182,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.38300000000000001,"5min":0.45200000000000001,"15min":0.47099999999999997},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.255,"15min":0.25600000000000001},"min":{"1min":0.20699999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.40500000000000003,"5min":0.48999999999999999,"15min":0.50600000000000001},"last":0.29899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740668,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.20699999999999999,"5min":0.20599999999999999,"15min":0.22},"min":{"1min":0.14000000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.34399999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.19},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26700000000000002,"15min":0.26900000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.41699999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.27700000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.23499999999999999},"min":{"1min":0.159,"5min":0.159,"15min":0.14999999999999999},"max":{"1min":0.38600000000000001,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.24399999999999999},"min":{"1min":0.17799999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.39600000000000002,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.20699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740673,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:32:20 2023","interfaces":[{"interface":"back","average":{"1min":0.19800000000000001,"5min":0.20999999999999999,"15min":0.214},"min":{"1min":0.13800000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.33100000000000002,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.26900000000000002,"15min":0.27100000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.39000000000000001,"5min":0.442,"15min":0.504},"last":0.27700000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:32:20 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23699999999999999,"15min":0.23599999999999999},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.16500000000000001},"max":{"1min":0.34300000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.214},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.27100000000000002,"15min":0.26600000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.187},"max":{"1min":0.36799999999999999,"5min":0.499,"15min":0.499},"last":0.247}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:32:29.654 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:29.654 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:29.654 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:29.654 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:29.655 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:29.655 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:29.655 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:32:30.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:30.196+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:30.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:30.217+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:31.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:31.234+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:31.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:31.267+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:32.262 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:32.260+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:32.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:32.302+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:33.249 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:33.244+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:33.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:33.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:34.200 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:34.198+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:34.398 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:34.396+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:35.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:35.194+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:35.386 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:35.384+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:36.178 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:36.176+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:36.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:36.379+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:37.195 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:37.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:37.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:37.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:38.166 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:38.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:38.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:38.352+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:39.170 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:39.168+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:39.344 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:39.342+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:40.186 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:40.184+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:40.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:40.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:41.194 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:41.193+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:41.371 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:41.369+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:42.154 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:42.152+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:42.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:42.343+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:43.191 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:43.190+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:43.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:43.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:44.215 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:44.214+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:44.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:44.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:45.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:45.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:45.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:45.409+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:46.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:46.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:46.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:46.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:47.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:47.188+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:47.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:47.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:48.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:48.180+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:48.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:48.438+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:49.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:49.141+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:49.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:49.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:49.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:32:49.944 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:32:49.947 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:32:49.957 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5902,"stamp":"2023-12-06T07:32:48.186456+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002010"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740671,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:32:43 2023","interfaces":[{"interface":"back","average":{"1min":0.247,"5min":0.219,"15min":0.222},"min":{"1min":0.153,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.44400000000000001,"5min":0.501,"15min":0.501},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.26700000000000002,"15min":0.26300000000000001},"min":{"1min":0.20200000000000001,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":0.46300000000000002,"5min":0.50900000000000001,"15min":0.51400000000000001},"last":0.41199999999999998}]},{"osd":1,"last update":"Wed Dec 6 07:32:43 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.23000000000000001,"15min":0.22800000000000001},"min":{"1min":0.17799999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.42399999999999999,"5min":0.45200000000000001,"15min":0.47099999999999997},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.26000000000000001,"15min":0.25800000000000001},"min":{"1min":0.20000000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.45400000000000001,"5min":0.48999999999999999,"15min":0.50600000000000001},"last":0.39200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740672,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.20699999999999999,"5min":0.20599999999999999,"15min":0.22},"min":{"1min":0.14000000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.34399999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26700000000000002,"15min":0.26900000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.41699999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.39600000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.23499999999999999},"min":{"1min":0.159,"5min":0.159,"15min":0.14999999999999999},"max":{"1min":0.38600000000000001,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.24399999999999999},"min":{"1min":0.17799999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.39600000000000002,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.371}]}]},{"osd":1,"up_from":8,"seq":34359740677,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:32:20 2023","interfaces":[{"interface":"back","average":{"1min":0.19800000000000001,"5min":0.20999999999999999,"15min":0.214},"min":{"1min":0.13800000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.33100000000000002,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.191},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.26900000000000002,"15min":0.27100000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.39000000000000001,"5min":0.442,"15min":0.504},"last":0.252}]},{"osd":2,"last update":"Wed Dec 6 07:32:20 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23699999999999999,"15min":0.23599999999999999},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.16500000000000001},"max":{"1min":0.34300000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.27100000000000002,"15min":0.26600000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.187},"max":{"1min":0.36799999999999999,"5min":0.499,"15min":0.499},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:32:49.958 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:49.958 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:49.958 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:49.959 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:49.959 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:49.959 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:32:49.959 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:32:50.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:50.099+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:50.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:50.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:51.101 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:51.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:51.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:51.484+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:52.098 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:52.097+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:52.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:52.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:53.132 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:53.131+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:53.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:53.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:54.165 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:54.164+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:54.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:54.492+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:55.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:55.138+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:55.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:55.476+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:56.168 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:56.166+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:56.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:56.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:57.134 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:57.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:57.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:57.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:58.176 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:58.174+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:58.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:58.589+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:59.156 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:32:59.154+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:32:59.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:32:59.546+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:00.127 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:00.124+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:00.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:00.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:01.087 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:01.084+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:01.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:01.561+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:02.085 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:02.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:02.573 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:02.571+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:03.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:03.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:03.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:03.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:04.049 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:04.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:04.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:04.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:05.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:05.020+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:05.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:05.580+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:06.055 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:06.054+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:06.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:06.563+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:07.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:07.078+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:07.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:07.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:08.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:08.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:08.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:08.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:09.125 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:09.121+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:09.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:09.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:09.960 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:33:10.096 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:10.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:10.271 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:33:10.273 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:33:10.285 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5913,"stamp":"2023-12-06T07:33:10.190133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002003"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740675,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:32:43 2023","interfaces":[{"interface":"back","average":{"1min":0.247,"5min":0.219,"15min":0.222},"min":{"1min":0.153,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.44400000000000001,"5min":0.501,"15min":0.501},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.26700000000000002,"15min":0.26300000000000001},"min":{"1min":0.20200000000000001,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":0.46300000000000002,"5min":0.50900000000000001,"15min":0.51400000000000001},"last":0.26400000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:32:43 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.23000000000000001,"15min":0.22800000000000001},"min":{"1min":0.17799999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.42399999999999999,"5min":0.45200000000000001,"15min":0.47099999999999997},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.26000000000000001,"15min":0.25800000000000001},"min":{"1min":0.20000000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.45400000000000001,"5min":0.48999999999999999,"15min":0.50600000000000001},"last":0.24299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740676,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.20699999999999999,"5min":0.20599999999999999,"15min":0.22},"min":{"1min":0.14000000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.34399999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.222},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26700000000000002,"15min":0.26900000000000002},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.41699999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.30399999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:32:15 2023","interfaces":[{"interface":"back","average":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.23499999999999999},"min":{"1min":0.159,"5min":0.159,"15min":0.14999999999999999},"max":{"1min":0.38600000000000001,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.24299999999999999,"5min":0.23899999999999999,"15min":0.24399999999999999},"min":{"1min":0.17799999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.39600000000000002,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.25800000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740681,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:32:20 2023","interfaces":[{"interface":"back","average":{"1min":0.19800000000000001,"5min":0.20999999999999999,"15min":0.214},"min":{"1min":0.13800000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.33100000000000002,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.26900000000000002,"15min":0.27100000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.39000000000000001,"5min":0.442,"15min":0.504},"last":0.25900000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:32:20 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23699999999999999,"15min":0.23599999999999999},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.16500000000000001},"max":{"1min":0.34300000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.27100000000000002,"15min":0.26600000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.187},"max":{"1min":0.36799999999999999,"5min":0.499,"15min":0.499},"last":0.28599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:33:10.286 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:10.286 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:10.286 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:10.286 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:10.287 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:10.287 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:10.287 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-12-06T07:33:10.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:10.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:10.620 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-12-06T07:33:10.632 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-12-06T07:33:10.926 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-12-06T07:33:10.937 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-12-06T07:33:11.116 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:11.114+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:11.234 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-12-06T07:33:11.246 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-12-06T07:33:11.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:11.502+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:11.558 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-12-06T07:33:11.569 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-12-06T07:33:11.868 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-12-06T07:33:11.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-12-06T07:33:12.159 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:12.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:12.217 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-12-06T07:33:12.228 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:33:12.458 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:12.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:13.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:13.134+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:13.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:13.463+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:14.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:14.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:14.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:14.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:15.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:15.060+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:15.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:15.411+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:16.017 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:16.015+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:16.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:16.443+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:16.992 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:16.990+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:17.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:17.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:17.982 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:17.980+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:18.457 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:18.455+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:18.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:18.938+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:19.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:19.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:19.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:19.984+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:20.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:20.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:20.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:20.936+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:21.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:21.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:21.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:21.907+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:22.534 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:22.532+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:22.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:22.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:23.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:23.554+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:23.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:23.863+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:24.561 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:24.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:24.863 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:24.862+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:25.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:25.597+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:25.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:25.909+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:26.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:26.645+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:26.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:26.890+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:27.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:27.607+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:27.901 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:27.900+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:28.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:28.647+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:28.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:28.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:29.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:29.644+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:29.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:29.882+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:30.653 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:30.652+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:30.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:30.858+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:31.669 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:31.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:31.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:31.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:32.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:33:32.526 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:33:32.526 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:33:32.536 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5924,"stamp":"2023-12-06T07:33:32.193220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001739"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740680,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:32:43 2023","interfaces":[{"interface":"back","average":{"1min":0.247,"5min":0.219,"15min":0.222},"min":{"1min":0.153,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.44400000000000001,"5min":0.501,"15min":0.501},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.28899999999999998,"5min":0.26700000000000002,"15min":0.26300000000000001},"min":{"1min":0.20200000000000001,"5min":0.188,"15min":0.17000000000000001},"max":{"1min":0.46300000000000002,"5min":0.50900000000000001,"15min":0.51400000000000001},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:32:43 2023","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.23000000000000001,"15min":0.22800000000000001},"min":{"1min":0.17799999999999999,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.42399999999999999,"5min":0.45200000000000001,"15min":0.47099999999999997},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.26000000000000001,"15min":0.25800000000000001},"min":{"1min":0.20000000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.45400000000000001,"5min":0.48999999999999999,"15min":0.50600000000000001},"last":0.28299999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740681,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.22},"min":{"1min":0.16500000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.36899999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.26900000000000002},"min":{"1min":0.22600000000000001,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.45700000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.249}]},{"osd":2,"last update":"Wed Dec 6 07:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.23599999999999999,"15min":0.23699999999999999},"min":{"1min":0.19400000000000001,"5min":0.159,"15min":0.14999999999999999},"max":{"1min":0.42399999999999999,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.23999999999999999,"15min":0.24299999999999999},"min":{"1min":0.189,"5min":0.17799999999999999,"15min":0.17699999999999999},"max":{"1min":0.378,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.22500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740686,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.20799999999999999,"15min":0.214},"min":{"1min":0.16300000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.35399999999999998,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.191},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.26900000000000002,"15min":0.27000000000000002},"min":{"1min":0.189,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.38700000000000001,"5min":0.442,"15min":0.48599999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Wed Dec 6 07:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23699999999999999,"15min":0.23499999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.16500000000000001},"max":{"1min":0.33300000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.315},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":0.36299999999999999,"5min":0.499,"15min":0.499},"last":0.254}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:33:32.538 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:32.538 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:32.538 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:32.538 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:32.539 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:32.539 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:32.539 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:33:32.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:32.644+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:32.930 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:32.930+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:33.680 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:33.679+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:33.967 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:33.966+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:34.635 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:34.634+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:34.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:34.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:35.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:35.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:35.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:35.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:36.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:36.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:36.905 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:36.904+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:37.676 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:37.674+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:37.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:37.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:38.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:38.642+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:38.890 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:38.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:39.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:39.645+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:39.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:39.845+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:40.663 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:40.661+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:40.817 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:40.815+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:41.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:41.617+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:41.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:41.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:42.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:42.617+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:42.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:42.807+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:43.651 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:43.649+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:43.774 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:43.772+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:44.693 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:44.691+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:44.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:44.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:45.732 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:45.730+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:45.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:45.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:46.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:46.732+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:46.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:46.763+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:47.723 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:47.721+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:47.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:47.773+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:48.716 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:48.714+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:48.815 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:48.813+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:49.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:49.731+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:49.856 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:49.855+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:50.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:50.773+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:50.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:50.826+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:51.736 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:51.734+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:51.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:51.833+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:52.540 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:33:52.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:52.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:52.817 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:52.815+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:33:52.846 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:33:52.857 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5934,"stamp":"2023-12-06T07:33:52.196169+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001795"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740684,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22,"15min":0.223},"min":{"1min":0.159,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.374,"5min":0.44400000000000001,"15min":0.501},"last":0.191},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.26500000000000001},"min":{"1min":0.21199999999999999,"5min":0.188,"15min":0.17799999999999999},"max":{"1min":0.42799999999999999,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.26000000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23000000000000001},"min":{"1min":0.189,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.47099999999999997},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.26400000000000001,"15min":0.26100000000000001},"min":{"1min":0.221,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.40200000000000002,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.27400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740685,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.22},"min":{"1min":0.16500000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.36899999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.17100000000000001},{"interface":"front","average":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.26900000000000002},"min":{"1min":0.22600000000000001,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.45700000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.23799999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.23599999999999999,"15min":0.23699999999999999},"min":{"1min":0.19400000000000001,"5min":0.159,"15min":0.14999999999999999},"max":{"1min":0.42399999999999999,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.23999999999999999,"15min":0.24299999999999999},"min":{"1min":0.189,"5min":0.17799999999999999,"15min":0.17699999999999999},"max":{"1min":0.378,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740690,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.20799999999999999,"15min":0.214},"min":{"1min":0.16300000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.35399999999999998,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.26900000000000002,"15min":0.27000000000000002},"min":{"1min":0.189,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.38700000000000001,"5min":0.442,"15min":0.48599999999999999},"last":0.221}]},{"osd":2,"last update":"Wed Dec 6 07:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23699999999999999,"15min":0.23499999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.16500000000000001},"max":{"1min":0.33300000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.16},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":0.36299999999999999,"5min":0.499,"15min":0.499},"last":0.193}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:33:52.858 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:52.858 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:52.859 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:52.859 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:52.859 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:52.859 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:33:52.859 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:33:53.741 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:53.739+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:53.853 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:53.851+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:54.719 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:54.717+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:54.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:54.902+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:55.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:55.677+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:55.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:55.889+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:56.652 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:56.650+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:56.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:56.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:57.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:57.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:57.836 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:57.834+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:58.630 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:58.629+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:58.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:58.843+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:59.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:33:59.640+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:33:59.811 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:33:59.810+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:00.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:00.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:00.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:00.784+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:01.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:01.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:01.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:01.739+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:02.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:02.590+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:02.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:02.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:03.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:03.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:03.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:03.763+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:04.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:04.597+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:04.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:04.795+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:05.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:05.605+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:05.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:05.760+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:06.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:06.611+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:06.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:06.794+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:07.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:07.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:07.771 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:07.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:08.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:08.606+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:08.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:08.795+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:09.622 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:09.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:09.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:09.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:10.601 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:10.600+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:10.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:10.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:11.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:11.635+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:11.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:11.747+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:12.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:12.677+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:12.758 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:12.757+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:12.860 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:34:13.154 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:34:13.155 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:34:13.165 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5944,"stamp":"2023-12-06T07:34:12.199116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001710"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740688,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22,"15min":0.223},"min":{"1min":0.159,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.374,"5min":0.44400000000000001,"15min":0.501},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.26500000000000001},"min":{"1min":0.21199999999999999,"5min":0.188,"15min":0.17799999999999999},"max":{"1min":0.42799999999999999,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.27100000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23000000000000001},"min":{"1min":0.189,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.47099999999999997},"last":0.222},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.26400000000000001,"15min":0.26100000000000001},"min":{"1min":0.221,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.40200000000000002,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.253}]}]},{"osd":0,"up_from":8,"seq":34359740689,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.22},"min":{"1min":0.16500000000000001,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.36899999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.17399999999999999},{"interface":"front","average":{"1min":0.27700000000000002,"5min":0.27100000000000002,"15min":0.26900000000000002},"min":{"1min":0.22600000000000001,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.45700000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.254}]},{"osd":2,"last update":"Wed Dec 6 07:33:16 2023","interfaces":[{"interface":"back","average":{"1min":0.25900000000000001,"5min":0.23599999999999999,"15min":0.23699999999999999},"min":{"1min":0.19400000000000001,"5min":0.159,"15min":0.14999999999999999},"max":{"1min":0.42399999999999999,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.23799999999999999,"5min":0.23999999999999999,"15min":0.24299999999999999},"min":{"1min":0.189,"5min":0.17799999999999999,"15min":0.17699999999999999},"max":{"1min":0.378,"5min":0.40999999999999998,"15min":0.45700000000000002},"last":0.24099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740694,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.20799999999999999,"15min":0.214},"min":{"1min":0.16300000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.35399999999999998,"5min":0.39700000000000002,"15min":0.42599999999999999},"last":0.22},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.26900000000000002,"15min":0.27000000000000002},"min":{"1min":0.189,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.38700000000000001,"5min":0.442,"15min":0.48599999999999999},"last":0.25600000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:33:21 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23699999999999999,"15min":0.23499999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.16500000000000001},"max":{"1min":0.33300000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.187},"max":{"1min":0.36299999999999999,"5min":0.499,"15min":0.499},"last":0.27800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:34:13.167 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:13.167 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:13.167 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:13.169 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:13.169 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:13.169 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:13.170 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:34:13.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:13.637+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:13.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:13.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:14.650 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:14.649+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:14.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:14.781+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:15.661 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:15.660+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:15.746 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:15.746+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:16.651 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:16.650+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:16.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:16.720+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:17.628 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:17.627+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:17.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:17.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:18.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:18.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:18.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:18.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:19.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:19.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:19.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:19.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:20.612 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:20.611+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:20.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:20.750+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:21.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:21.575+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:21.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:21.770+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:22.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:22.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:22.819 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:22.818+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:23.554 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:23.552+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:23.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:23.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:24.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:24.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:24.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:24.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:25.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:25.553+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:25.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:25.704+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:26.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:26.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:26.736 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:26.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:27.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:27.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:27.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:27.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:28.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:28.467+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:28.755 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:28.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:29.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:29.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:29.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:29.764+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:30.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:30.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:30.813 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:30.812+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:31.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:31.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:31.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:31.796+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:32.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:32.471+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:32.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:32.802+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:33.171 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:34:33.483 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:34:33.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:33.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:33.485 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:34:33.496 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5954,"stamp":"2023-12-06T07:34:32.201990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001719"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740692,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22,"15min":0.223},"min":{"1min":0.159,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.374,"5min":0.44400000000000001,"15min":0.501},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.27200000000000002,"15min":0.26500000000000001},"min":{"1min":0.21199999999999999,"5min":0.188,"15min":0.17799999999999999},"max":{"1min":0.42799999999999999,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.27700000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:33:47 2023","interfaces":[{"interface":"back","average":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23000000000000001},"min":{"1min":0.189,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.47099999999999997},"last":0.23100000000000001},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.26400000000000001,"15min":0.26100000000000001},"min":{"1min":0.221,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.40200000000000002,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.26600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740693,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.21299999999999999,"15min":0.217},"min":{"1min":0.151,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.439,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.26900000000000002},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.44600000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.23699999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.24299999999999999,"15min":0.23599999999999999},"min":{"1min":0.191,"5min":0.159,"15min":0.159},"max":{"1min":0.40699999999999997,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.183},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.24199999999999999},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.45700000000000002},"last":0.21099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740698,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20000000000000001,"15min":0.21099999999999999},"min":{"1min":0.14599999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.245,"5min":0.35499999999999998,"15min":0.42599999999999999},"last":0.184},{"interface":"front","average":{"1min":0.25,"5min":0.25900000000000001,"15min":0.26800000000000002},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.312,"5min":0.40400000000000003,"15min":0.46100000000000002},"last":0.22700000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.22800000000000001,"15min":0.23499999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.315,"5min":0.34399999999999997,"15min":0.47499999999999998},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.25900000000000001,"15min":0.26400000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.187},"max":{"1min":0.30299999999999999,"5min":0.377,"15min":0.499},"last":0.247}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:34:33.497 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:33.497 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:33.497 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:33.497 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:33.498 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:33.498 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:33.498 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:34:33.817 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:33.815+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:34.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:34.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:34.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:34.825+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:35.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:35.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:35.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:35.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:36.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:36.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:36.796 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:36.794+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:37.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:37.539+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:37.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:37.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:38.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:38.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:38.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:38.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:39.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:39.600+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:39.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:39.792+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:40.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:40.556+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:40.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:40.788+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:41.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:41.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:41.826 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:41.824+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:42.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:42.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:42.781 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:42.779+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:43.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:43.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:43.765 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:43.761+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:44.560 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:44.558+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:44.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:44.719+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:45.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:45.585+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:45.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:45.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:46.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:46.618+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:46.709 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:46.708+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:47.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:47.632+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:47.670 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:47.668+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:48.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:48.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:48.684 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:48.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:49.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:49.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:49.721 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:49.720+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:50.542 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:50.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:50.759 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:50.757+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:51.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:51.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:51.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:51.734+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:52.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:52.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:52.716 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:52.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:53.499 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:34:53.591 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:53.590+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:53.698 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:53.697+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:53.835 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:34:53.838 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:34:53.849 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5964,"stamp":"2023-12-06T07:34:52.205120+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001955"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740696,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.222,"15min":0.22500000000000001},"min":{"1min":0.16300000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.32300000000000001,"5min":0.44400000000000001,"15min":0.501},"last":0.19},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.27300000000000002,"15min":0.26700000000000002},"min":{"1min":0.20799999999999999,"5min":0.188,"15min":0.17799999999999999},"max":{"1min":0.372,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.25900000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23499999999999999,"15min":0.23100000000000001},"min":{"1min":0.187,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.33200000000000002,"5min":0.44,"15min":0.47099999999999997},"last":0.222},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.26600000000000001,"15min":0.26200000000000001},"min":{"1min":0.21299999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.35899999999999999,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.249}]}]},{"osd":0,"up_from":8,"seq":34359740697,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.21299999999999999,"15min":0.217},"min":{"1min":0.151,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.439,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.26900000000000002},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.44600000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.26900000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.24299999999999999,"15min":0.23599999999999999},"min":{"1min":0.191,"5min":0.159,"15min":0.159},"max":{"1min":0.40699999999999997,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.224},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.24199999999999999},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.45700000000000002},"last":0.24199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740702,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20000000000000001,"15min":0.21099999999999999},"min":{"1min":0.14599999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.245,"5min":0.35499999999999998,"15min":0.42599999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.25,"5min":0.25900000000000001,"15min":0.26800000000000002},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.312,"5min":0.40400000000000003,"15min":0.46100000000000002},"last":0.42699999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.22800000000000001,"15min":0.23499999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.315,"5min":0.34399999999999997,"15min":0.47499999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.252,"5min":0.25900000000000001,"15min":0.26400000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.187},"max":{"1min":0.30299999999999999,"5min":0.377,"15min":0.499},"last":0.39800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:34:53.850 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:53.850 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:53.851 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:53.851 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:53.851 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:53.851 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:34:53.851 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:34:54.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:54.606+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:54.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:54.680+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:55.610 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:55.608+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:55.633 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:55.632+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:56.611 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:56.610+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:56.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:56.624+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:57.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:57.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:57.631 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:57.630+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:58.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:58.589+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:58.675 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:58.674+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:59.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:34:59.551+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:34:59.672 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:34:59.671+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:00.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:00.522+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:00.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:00.680+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:01.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:01.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:01.713 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:01.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:02.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:02.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:02.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:02.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:03.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:03.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:03.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:03.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:04.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:04.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:04.737 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:04.735+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:05.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:05.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:05.775 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:05.773+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:06.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:06.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:06.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:06.821+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:07.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:07.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:07.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:07.776+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:08.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:08.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:08.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:08.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:09.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:09.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:09.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:09.821+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:10.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:10.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:10.783 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:10.782+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:11.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:11.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:11.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:11.751+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:12.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:12.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:12.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:12.795+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:13.471 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:13.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:13.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:13.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:13.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:35:14.146 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:35:14.147 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:35:14.158 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5974,"stamp":"2023-12-06T07:35:12.208241+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001869"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740700,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.222,"15min":0.22500000000000001},"min":{"1min":0.16300000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.32300000000000001,"5min":0.44400000000000001,"15min":0.501},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.27300000000000002,"15min":0.26700000000000002},"min":{"1min":0.20799999999999999,"5min":0.188,"15min":0.17799999999999999},"max":{"1min":0.372,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.24299999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23499999999999999,"15min":0.23100000000000001},"min":{"1min":0.187,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.33200000000000002,"5min":0.44,"15min":0.47099999999999997},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.26600000000000001,"15min":0.26200000000000001},"min":{"1min":0.21299999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.35899999999999999,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.23300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740701,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.21299999999999999,"15min":0.217},"min":{"1min":0.151,"5min":0.13800000000000001,"15min":0.13800000000000001},"max":{"1min":0.439,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.185},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.26900000000000002},"min":{"1min":0.218,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.44600000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.28399999999999997}]},{"osd":2,"last update":"Wed Dec 6 07:34:17 2023","interfaces":[{"interface":"back","average":{"1min":0.249,"5min":0.24299999999999999,"15min":0.23599999999999999},"min":{"1min":0.191,"5min":0.159,"15min":0.159},"max":{"1min":0.40699999999999997,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.25},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.24199999999999999},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.45700000000000002},"last":0.224}]}]},{"osd":1,"up_from":8,"seq":34359740706,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.20000000000000001,"15min":0.21099999999999999},"min":{"1min":0.14599999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.245,"5min":0.35499999999999998,"15min":0.42599999999999999},"last":0.23899999999999999},{"interface":"front","average":{"1min":0.25,"5min":0.25900000000000001,"15min":0.26800000000000002},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.312,"5min":0.40400000000000003,"15min":0.46100000000000002},"last":0.28399999999999997}]},{"osd":2,"last update":"Wed Dec 6 07:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.22800000000000001,"15min":0.23499999999999999},"min":{"1min":0.16,"5min":0.16,"15min":0.16},"max":{"1min":0.315,"5min":0.34399999999999997,"15min":0.47499999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.252,"5min":0.25900000000000001,"15min":0.26400000000000001},"min":{"1min":0.193,"5min":0.193,"15min":0.187},"max":{"1min":0.30299999999999999,"5min":0.377,"15min":0.499},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:35:14.159 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:14.159 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:14.159 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:14.160 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:14.160 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:14.160 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:14.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-12-06T07:35:14.458 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-12-06T07:35:14.470 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-12-06T07:35:14.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:14.494+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:14.810 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-12-06T07:35:14.819 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-12-06T07:35:14.836 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:14.834+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:15.131 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-12-06T07:35:15.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-12-06T07:35:15.447 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-12-06T07:35:15.459 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-12-06T07:35:15.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:15.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:15.759 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-12-06T07:35:15.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-12-06T07:35:15.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:15.809+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:16.109 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-12-06T07:35:16.119 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:35:16.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:16.477+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:16.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:16.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:17.509 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:17.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:17.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:17.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:18.551 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:18.549+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:18.792 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:18.790+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:19.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:19.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:19.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:19.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:20.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:20.582+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:20.788 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:20.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:21.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:21.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:21.757 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:21.755+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:22.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:22.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:22.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:22.760+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:23.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:23.617+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:23.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:23.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:24.639 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:24.637+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:24.700 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:24.698+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:25.632 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:25.631+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:25.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:25.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:26.662 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:26.660+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:26.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:26.716+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:27.678 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:27.676+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:27.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:27.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:28.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:28.695+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:28.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:28.761+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:29.718 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:29.716+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:29.803 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:29.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:30.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:30.747+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:30.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:30.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:31.735 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:31.733+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:31.792 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:31.791+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:32.741 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:32.739+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:32.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:32.749+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:33.707 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:33.705+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:33.718 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:33.715+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:34.736 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:34.734+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:34.754 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:34.753+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:35.710 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:35.710+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:35.770 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:35.769+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:36.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:35:36.412 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:35:36.414 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:35:36.425 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5986,"stamp":"2023-12-06T07:35:36.211940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001819"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740704,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.222,"15min":0.22500000000000001},"min":{"1min":0.16300000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.32300000000000001,"5min":0.44400000000000001,"15min":0.501},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.27300000000000002,"15min":0.26700000000000002},"min":{"1min":0.20799999999999999,"5min":0.188,"15min":0.17799999999999999},"max":{"1min":0.372,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.22}]},{"osd":1,"last update":"Wed Dec 6 07:34:48 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23499999999999999,"15min":0.23100000000000001},"min":{"1min":0.187,"5min":0.16200000000000001,"15min":0.16200000000000001},"max":{"1min":0.33200000000000002,"5min":0.44,"15min":0.47099999999999997},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.26400000000000001,"5min":0.26600000000000001,"15min":0.26200000000000001},"min":{"1min":0.21299999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.35899999999999999,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.26300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740706,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:35:19 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.215,"15min":0.215},"min":{"1min":0.16500000000000001,"5min":0.14000000000000001,"15min":0.13800000000000001},"max":{"1min":0.35599999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.185},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27500000000000002,"15min":0.26900000000000002},"min":{"1min":0.21299999999999999,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.38900000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.28199999999999997}]},{"osd":2,"last update":"Wed Dec 6 07:35:19 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.183,"5min":0.159,"15min":0.159},"max":{"1min":0.34499999999999997,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.248},{"interface":"front","average":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24199999999999999},"min":{"1min":0.19800000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.378,"5min":0.42899999999999999,"15min":0.45700000000000002},"last":0.223}]}]},{"osd":1,"up_from":8,"seq":34359740711,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.20399999999999999,"15min":0.20999999999999999},"min":{"1min":0.13300000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.40600000000000003},"last":0.19800000000000001},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26700000000000002},"min":{"1min":0.183,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.46100000000000002},"last":0.29599999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23400000000000001},"min":{"1min":0.16700000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.47499999999999998},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.26400000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.187},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.499},"last":0.26400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:35:36.427 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:36.428 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:36.428 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:36.429 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:36.429 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:36.429 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:36.430 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:35:36.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:36.731+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:36.767 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:36.766+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:37.759 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:37.758+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:37.778 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:37.776+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:38.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:38.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:38.772 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:38.771+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:39.728 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:39.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:39.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:39.748+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:40.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:40.697+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:40.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:40.763+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:41.665 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:41.664+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:41.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:41.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:42.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:42.696+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:42.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:42.762+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:43.656 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:43.655+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:43.760 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:43.759+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:44.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:44.696+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:44.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:44.728+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:45.686 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:45.685+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:45.741 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:45.740+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:46.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:46.642+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:46.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:46.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:47.600 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:47.598+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:47.788 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:47.786+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:48.574 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:48.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:48.786 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:48.784+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:49.564 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:49.563+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:49.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:49.767+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:50.542 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:50.540+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:50.788 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:50.786+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:51.548 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:51.547+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:51.810 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:51.808+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:52.559 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:52.557+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:52.799 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:52.797+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:53.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:53.601+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:53.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:53.758+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:54.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:54.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:54.783 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:54.781+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:55.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:55.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:55.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:55.741+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:56.433 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:35:56.662 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:56.661+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:56.735 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:56.733+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:56.742 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:35:56.744 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:35:56.755 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":5996,"stamp":"2023-12-06T07:35:56.215118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001809"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740708,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.22600000000000001,"15min":0.22500000000000001},"min":{"1min":0.17299999999999999,"5min":0.153,"15min":0.13700000000000001},"max":{"1min":0.39200000000000002,"5min":0.44400000000000001,"15min":0.501},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.27400000000000002,"15min":0.26700000000000002},"min":{"1min":0.22,"5min":0.20200000000000001,"15min":0.17799999999999999},"max":{"1min":0.38300000000000001,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.245}]},{"osd":1,"last update":"Wed Dec 6 07:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23699999999999999,"15min":0.23100000000000001},"min":{"1min":0.189,"5min":0.17799999999999999,"15min":0.16200000000000001},"max":{"1min":0.37,"5min":0.44,"15min":0.47099999999999997},"last":0.223},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26900000000000002,"15min":0.26200000000000001},"min":{"1min":0.21099999999999999,"5min":0.20000000000000001,"15min":0.17100000000000001},"max":{"1min":0.40300000000000002,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.25700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740710,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:35:19 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.215,"15min":0.215},"min":{"1min":0.16500000000000001,"5min":0.14000000000000001,"15min":0.13800000000000001},"max":{"1min":0.35599999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27500000000000002,"15min":0.26900000000000002},"min":{"1min":0.21299999999999999,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.38900000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.26400000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:35:19 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.183,"5min":0.159,"15min":0.159},"max":{"1min":0.34499999999999997,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24199999999999999},"min":{"1min":0.19800000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.378,"5min":0.42899999999999999,"15min":0.45700000000000002},"last":0.20300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740715,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.20399999999999999,"15min":0.20999999999999999},"min":{"1min":0.13300000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.40600000000000003},"last":0.215},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26700000000000002},"min":{"1min":0.183,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.46100000000000002},"last":0.20200000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23400000000000001},"min":{"1min":0.16700000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.47499999999999998},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.26400000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.187},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.499},"last":0.22600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:35:56.756 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:56.756 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:56.757 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:56.757 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:56.757 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:56.757 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:35:56.757 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:35:57.683 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:57.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:57.726 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:57.725+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:58.703 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:58.701+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:58.760 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:58.759+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:59.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:35:59.679+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:35:59.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:35:59.731+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:00.666 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:00.664+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:00.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:00.689+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:01.646 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:01.645+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:01.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:01.695+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:02.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:02.688+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:02.736 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:02.735+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:03.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:03.697+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:03.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:03.703+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:04.694 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:04.692+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:04.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:04.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:05.670 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:05.669+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:05.706 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:05.704+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:06.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:06.662+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:06.741 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:06.739+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:07.640 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:07.638+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:07.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:07.706+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:08.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:08.591+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:08.726 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:08.724+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:09.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:09.600+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:09.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:09.688+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:10.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:10.569+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:10.644 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:10.643+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:11.575 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:11.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:11.610 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:11.609+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:12.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:12.541+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:12.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:12.579+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:13.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:13.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:13.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:13.581+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:14.525 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:14.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:14.624 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:14.622+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:15.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:15.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:15.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:15.657+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:16.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:16.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:16.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:16.680+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:16.758 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:36:17.072 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:36:17.074 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:36:17.085 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6006,"stamp":"2023-12-06T07:36:16.218375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001936"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740712,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.22600000000000001,"15min":0.22500000000000001},"min":{"1min":0.17299999999999999,"5min":0.153,"15min":0.13700000000000001},"max":{"1min":0.39200000000000002,"5min":0.44400000000000001,"15min":0.501},"last":0.439},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.27400000000000002,"15min":0.26700000000000002},"min":{"1min":0.22,"5min":0.20200000000000001,"15min":0.17799999999999999},"max":{"1min":0.38300000000000001,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.42699999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23699999999999999,"15min":0.23100000000000001},"min":{"1min":0.189,"5min":0.17799999999999999,"15min":0.16200000000000001},"max":{"1min":0.37,"5min":0.44,"15min":0.47099999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26900000000000002,"15min":0.26200000000000001},"min":{"1min":0.21099999999999999,"5min":0.20000000000000001,"15min":0.17100000000000001},"max":{"1min":0.40300000000000002,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.45200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740714,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:35:19 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.215,"15min":0.215},"min":{"1min":0.16500000000000001,"5min":0.14000000000000001,"15min":0.13800000000000001},"max":{"1min":0.35599999999999998,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27500000000000002,"15min":0.26900000000000002},"min":{"1min":0.21299999999999999,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.38900000000000001,"5min":0.64600000000000002,"15min":0.64600000000000002},"last":0.27000000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:35:19 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.183,"5min":0.159,"15min":0.159},"max":{"1min":0.34499999999999997,"5min":0.45100000000000001,"15min":0.50900000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24199999999999999},"min":{"1min":0.19800000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.378,"5min":0.42899999999999999,"15min":0.45700000000000002},"last":0.20999999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740719,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.20399999999999999,"15min":0.20999999999999999},"min":{"1min":0.13300000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.40600000000000003},"last":0.14599999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26200000000000001,"15min":0.26700000000000002},"min":{"1min":0.183,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.46100000000000002},"last":0.19800000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:35:27 2023","interfaces":[{"interface":"back","average":{"1min":0.25,"5min":0.23300000000000001,"15min":0.23400000000000001},"min":{"1min":0.16700000000000001,"5min":0.16,"15min":0.16},"max":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.47499999999999998},"last":0.156},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.26500000000000001,"15min":0.26400000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.187},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.499},"last":0.17999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:36:17.086 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:17.086 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:17.086 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:17.087 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:17.087 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:17.087 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:17.087 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:36:17.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:17.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:17.633 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:17.632+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:18.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:18.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:18.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:18.667+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:19.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:19.454+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:19.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:19.688+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:20.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:20.415+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:20.673 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:20.672+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:21.392 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:21.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:21.638 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:21.637+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:22.387 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:22.386+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:22.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:22.625+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:23.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:23.362+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:23.578 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:23.578+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:24.407 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:24.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:24.566 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:24.565+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:25.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:25.410+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:25.582 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:25.582+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:26.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:26.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:26.545 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:26.544+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:27.411 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:27.410+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:27.506 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:27.506+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:28.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:28.429+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:28.494 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:28.494+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:29.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:29.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:29.502 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:29.501+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:30.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:30.433+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:30.601 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:30.524+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:31.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:31.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:31.558 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:31.557+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:32.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:32.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:32.602 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:32.600+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:33.395 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:33.393+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:33.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:33.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:34.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:34.435+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:34.601 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:34.599+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:35.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:35.421+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:35.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:35.610+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:36.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:36.444+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:36.572 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:36.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:37.088 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:36:37.402 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:36:37.404 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:36:37.415 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6016,"stamp":"2023-12-06T07:36:36.221301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001834"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740716,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.22600000000000001,"15min":0.22500000000000001},"min":{"1min":0.17299999999999999,"5min":0.153,"15min":0.13700000000000001},"max":{"1min":0.39200000000000002,"5min":0.44400000000000001,"15min":0.501},"last":0.17999999999999999},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.27400000000000002,"15min":0.26700000000000002},"min":{"1min":0.22,"5min":0.20200000000000001,"15min":0.17799999999999999},"max":{"1min":0.38300000000000001,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.25700000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:35:49 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.23699999999999999,"15min":0.23100000000000001},"min":{"1min":0.189,"5min":0.17799999999999999,"15min":0.16200000000000001},"max":{"1min":0.37,"5min":0.44,"15min":0.47099999999999997},"last":0.21299999999999999},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26900000000000002,"15min":0.26200000000000001},"min":{"1min":0.21099999999999999,"5min":0.20000000000000001,"15min":0.17100000000000001},"max":{"1min":0.40300000000000002,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.245}]}]},{"osd":0,"up_from":8,"seq":34359740718,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.20899999999999999,"15min":0.21299999999999999},"min":{"1min":0.13500000000000001,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.308,"5min":0.439,"15min":0.63400000000000001},"last":0.245},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26900000000000002,"15min":0.26700000000000002},"min":{"1min":0.20100000000000001,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.373,"5min":0.45700000000000002,"15min":0.64600000000000002},"last":0.27100000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.24199999999999999,"15min":0.23599999999999999},"min":{"1min":0.17599999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.34499999999999997,"5min":0.42399999999999999,"15min":0.45100000000000001},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.23799999999999999,"15min":0.23999999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.33100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.21099999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740723,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.19600000000000001,"5min":0.20399999999999999,"15min":0.20799999999999999},"min":{"1min":0.14599999999999999,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.311,"5min":0.39100000000000001,"15min":0.40600000000000003},"last":0.189},{"interface":"front","average":{"1min":0.253,"5min":0.26000000000000001,"15min":0.26500000000000001},"min":{"1min":0.19800000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.34100000000000003,"5min":0.44400000000000001,"15min":0.45700000000000002},"last":0.25900000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.28799999999999998,"5min":0.42699999999999999,"15min":0.47499999999999998},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.25800000000000001,"15min":0.26200000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.31900000000000001,"5min":0.46500000000000002,"15min":0.499},"last":0.23400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:36:37.416 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:37.417 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:37.417 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:37.417 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:37.417 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:37.417 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:37.418 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:36:37.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:37.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:37.568 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:37.567+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:38.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:38.416+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:38.611 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:38.610+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:39.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:39.445+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:39.630 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:39.629+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:40.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:40.448+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:40.661 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:40.660+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:41.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:41.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:41.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:41.666+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:42.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:42.536+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:42.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:42.694+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:43.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:43.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:43.671 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:43.670+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:44.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:44.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:44.652 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:44.650+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:45.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:45.554+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:45.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:45.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:46.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:46.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:46.702 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:46.701+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:47.581 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:47.579+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:47.744 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:47.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:48.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:48.534+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:48.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:48.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:49.492 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:49.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:49.787 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:49.785+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:50.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:50.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:50.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:50.804+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:51.573 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:51.571+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:51.822 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:51.820+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:52.546 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:52.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:52.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:52.809+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:53.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:53.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:53.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:53.796+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:54.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:54.508+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:54.756 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:54.754+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:55.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:55.484+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:55.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:55.712+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:56.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:56.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:56.764 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:56.762+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:57.419 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:36:57.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:57.498+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:57.755 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:36:57.757 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:36:57.770 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6026,"stamp":"2023-12-06T07:36:56.224808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002240"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740720,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.22600000000000001},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.439,"5min":0.44400000000000001,"15min":0.501},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.26900000000000002},"min":{"1min":0.21099999999999999,"5min":0.20200000000000001,"15min":0.186},"max":{"1min":0.44800000000000001,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.255}]},{"osd":1,"last update":"Wed Dec 6 07:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.40600000000000003,"5min":0.44,"15min":0.47099999999999997},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27300000000000002,"15min":0.26500000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.23000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740722,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.20899999999999999,"15min":0.21299999999999999},"min":{"1min":0.13500000000000001,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.308,"5min":0.439,"15min":0.63400000000000001},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26900000000000002,"15min":0.26700000000000002},"min":{"1min":0.20100000000000001,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.373,"5min":0.45700000000000002,"15min":0.64600000000000002},"last":0.22800000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.24199999999999999,"15min":0.23599999999999999},"min":{"1min":0.17599999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.34499999999999997,"5min":0.42399999999999999,"15min":0.45100000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.23799999999999999,"15min":0.23999999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.33100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.21199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740727,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.19600000000000001,"5min":0.20399999999999999,"15min":0.20799999999999999},"min":{"1min":0.14599999999999999,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.311,"5min":0.39100000000000001,"15min":0.40600000000000003},"last":0.16300000000000001},{"interface":"front","average":{"1min":0.253,"5min":0.26000000000000001,"15min":0.26500000000000001},"min":{"1min":0.19800000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.34100000000000003,"5min":0.44400000000000001,"15min":0.45700000000000002},"last":0.224}]},{"osd":2,"last update":"Wed Dec 6 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.28799999999999998,"5min":0.42699999999999999,"15min":0.47499999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.25800000000000001,"15min":0.26200000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.31900000000000001,"5min":0.46500000000000002,"15min":0.499},"last":0.20100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:36:57.771 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:57.771 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:57.771 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:57.772 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:57.772 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:57.772 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:36:57.772 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:36:57.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:57.785+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:58.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:58.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:58.836 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:58.834+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:59.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:36:59.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:36:59.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:36:59.883+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:00.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:00.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:00.848 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:00.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:01.472 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:01.470+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:01.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:01.861+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:02.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:02.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:02.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:02.825+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:03.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:03.451+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:03.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:03.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:04.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:04.445+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:04.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:04.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:05.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:05.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:05.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:05.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:06.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:06.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:06.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:06.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:07.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:07.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:07.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:07.889+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:08.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:08.507+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:08.924 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:08.924+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:09.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:09.504+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:09.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:09.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:10.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:10.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:10.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:10.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:11.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:11.458+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:11.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:11.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:12.427 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:12.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:12.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:12.936+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:13.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:13.380+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:13.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:13.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:14.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:14.428+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:14.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:14.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:15.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:15.479+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:15.904 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:15.903+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:16.438 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:16.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:16.926 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:16.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:17.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:17.468+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:17.773 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:37:17.927 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:17.925+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:18.124 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:37:18.126 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:37:18.136 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6036,"stamp":"2023-12-06T07:37:16.227948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001937"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740724,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.22600000000000001},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.439,"5min":0.44400000000000001,"15min":0.501},"last":0.20000000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.26900000000000002},"min":{"1min":0.21099999999999999,"5min":0.20200000000000001,"15min":0.186},"max":{"1min":0.44800000000000001,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.27300000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.40600000000000003,"5min":0.44,"15min":0.47099999999999997},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27300000000000002,"15min":0.26500000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.26200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740726,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.20899999999999999,"15min":0.21299999999999999},"min":{"1min":0.13500000000000001,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.308,"5min":0.439,"15min":0.63400000000000001},"last":0.17799999999999999},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26900000000000002,"15min":0.26700000000000002},"min":{"1min":0.20100000000000001,"5min":0.19400000000000001,"15min":0.18099999999999999},"max":{"1min":0.373,"5min":0.45700000000000002,"15min":0.64600000000000002},"last":0.23799999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:36:19 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.24199999999999999,"15min":0.23599999999999999},"min":{"1min":0.17599999999999999,"5min":0.159,"15min":0.159},"max":{"1min":0.34499999999999997,"5min":0.42399999999999999,"15min":0.45100000000000001},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.22600000000000001,"5min":0.23799999999999999,"15min":0.23999999999999999},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.33100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.224}]}]},{"osd":1,"up_from":8,"seq":34359740731,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.19600000000000001,"5min":0.20399999999999999,"15min":0.20799999999999999},"min":{"1min":0.14599999999999999,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.311,"5min":0.39100000000000001,"15min":0.40600000000000003},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.253,"5min":0.26000000000000001,"15min":0.26500000000000001},"min":{"1min":0.19800000000000001,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.34100000000000003,"5min":0.44400000000000001,"15min":0.45700000000000002},"last":0.26800000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:36:28 2023","interfaces":[{"interface":"back","average":{"1min":0.222,"5min":0.23100000000000001,"15min":0.23300000000000001},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.28799999999999998,"5min":0.42699999999999999,"15min":0.47499999999999998},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.25800000000000001,"15min":0.26200000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.31900000000000001,"5min":0.46500000000000002,"15min":0.499},"last":0.28899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:37:18.138 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:18.138 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:18.138 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:18.138 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:18.138 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:18.139 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:18.139 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-12-06T07:37:18.467 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-12-06T07:37:18.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-12-06T07:37:18.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:18.503+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:18.776 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-12-06T07:37:18.788 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-12-06T07:37:18.972 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:18.969+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:19.130 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-12-06T07:37:19.142 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-12-06T07:37:19.443 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-12-06T07:37:19.455 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-12-06T07:37:19.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:19.462+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:19.757 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-12-06T07:37:19.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-12-06T07:37:19.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:19.931+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:20.113 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-12-06T07:37:20.123 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:37:20.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:20.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:20.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:20.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:21.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:21.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:21.867 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:21.866+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:22.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:22.459+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:22.864 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:22.863+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:23.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:23.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:23.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:23.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:24.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:24.413+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:24.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:24.897+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:25.442 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:25.441+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:25.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:25.913+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:26.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:26.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:26.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:26.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:27.477 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:27.475+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:27.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:27.919+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:28.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:28.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:28.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:28.931+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:29.520 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:29.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:29.921 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:29.920+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:30.504 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:30.503+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:30.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:30.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:31.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:31.500+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:31.892 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:31.891+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:32.496 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:32.495+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:32.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:32.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:33.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:33.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:33.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:33.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:34.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:34.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:34.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:34.912+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:35.408 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:35.406+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:35.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:35.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:36.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:36.417+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:36.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:36.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:37.454 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:37.453+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:37.915 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:37.913+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:38.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:38.443+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:38.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:38.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:39.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:39.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:39.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:39.951+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:40.125 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:37:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:37:40.425 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:37:40.436 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6048,"stamp":"2023-12-06T07:37:40.231708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001823"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740729,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.23499999999999999,"15min":0.22600000000000001},"min":{"1min":0.14999999999999999,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.439,"5min":0.44400000000000001,"15min":0.501},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.27800000000000002,"15min":0.26900000000000002},"min":{"1min":0.21099999999999999,"5min":0.20200000000000001,"15min":0.186},"max":{"1min":0.44800000000000001,"5min":0.46300000000000002,"15min":0.51400000000000001},"last":0.23000000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:36:50 2023","interfaces":[{"interface":"back","average":{"1min":0.24099999999999999,"5min":0.23999999999999999,"15min":0.23400000000000001},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.40600000000000003,"5min":0.44,"15min":0.47099999999999997},"last":0.189},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27300000000000002,"15min":0.26500000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.45200000000000001,"5min":0.45400000000000001,"15min":0.50600000000000001},"last":0.21099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740730,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.20499999999999999,"5min":0.20799999999999999,"15min":0.20999999999999999},"min":{"1min":0.14199999999999999,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.32500000000000001,"5min":0.439,"15min":0.63400000000000001},"last":0.16800000000000001},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.21199999999999999,"5min":0.20100000000000001,"15min":0.18099999999999999},"max":{"1min":0.39700000000000002,"5min":0.45700000000000002,"15min":0.64600000000000002},"last":0.25800000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.24399999999999999,"15min":0.23499999999999999},"min":{"1min":0.20000000000000001,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.36899999999999999,"5min":0.42399999999999999,"15min":0.45100000000000001},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.23599999999999999,"5min":0.23699999999999999,"15min":0.23799999999999999},"min":{"1min":0.19600000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.35199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.23200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740735,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20899999999999999},"min":{"1min":0.14399999999999999,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.38900000000000001,"5min":0.39100000000000001,"15min":0.40600000000000003},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.26100000000000001,"15min":0.26500000000000001},"min":{"1min":0.18099999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.40799999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.28299999999999997}]},{"osd":2,"last update":"Wed Dec 6 07:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.23599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"min":{"1min":0.184,"5min":0.156,"15min":0.156},"max":{"1min":0.38300000000000001,"5min":0.42699999999999999,"15min":0.47499999999999998},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.26300000000000001},"min":{"1min":0.20100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.435,"5min":0.46500000000000002,"15min":0.499},"last":0.25700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:37:40.438 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:40.438 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:40.438 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:40.438 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:40.439 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:40.439 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:37:40.439 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:37:40.494 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:40.493+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:40.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:40.987+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:41.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:41.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:41.990 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:41.988+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:42.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:42.554+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:43.034 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:43.033+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:43.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:43.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:44.022 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:44.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:44.555 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:44.554+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:44.995 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:44.994+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:45.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:45.529+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:45.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:45.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:46.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:46.482+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:46.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:46.929+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:47.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:47.508+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:47.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:47.899+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:48.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:48.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:48.919 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:48.919+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:49.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:49.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:49.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:49.892+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:50.501 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:50.500+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:50.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:50.869+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:51.550 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:51.550+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:51.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:51.897+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:52.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:52.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:52.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:52.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:53.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:53.535+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:53.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:53.909+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:54.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:54.548+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:54.872 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:54.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:55.570 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:55.567+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:55.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:55.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:56.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:56.559+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:56.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:56.864+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:57.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:57.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:57.880 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:57.879+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:58.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:58.563+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:58.912 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:58.910+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:59.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:37:59.514+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:37:59.896 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:37:59.894+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:00.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:38:00.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:00.519+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:00.742 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:38:00.744 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:38:00.755 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6058,"stamp":"2023-12-06T07:38:00.234503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001705"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740733,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.22800000000000001,"15min":0.22500000000000001},"min":{"1min":0.16400000000000001,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.32500000000000001,"5min":0.439,"15min":0.501},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.27200000000000002,"15min":0.26800000000000002},"min":{"1min":0.219,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.30199999999999999,"5min":0.44800000000000001,"15min":0.51400000000000001},"last":0.24299999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.23499999999999999,"15min":0.23200000000000001},"min":{"1min":0.17299999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.26700000000000002,"5min":0.44,"15min":0.47099999999999997},"last":0.185},{"interface":"front","average":{"1min":0.253,"5min":0.26800000000000002,"15min":0.26400000000000001},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.30399999999999999,"5min":0.45200000000000001,"15min":0.50600000000000001},"last":0.21199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740734,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.20499999999999999,"5min":0.20799999999999999,"15min":0.20999999999999999},"min":{"1min":0.14199999999999999,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.32500000000000001,"5min":0.439,"15min":0.63400000000000001},"last":0.187},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.21199999999999999,"5min":0.20100000000000001,"15min":0.18099999999999999},"max":{"1min":0.39700000000000002,"5min":0.45700000000000002,"15min":0.64600000000000002},"last":0.26200000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.24399999999999999,"15min":0.23499999999999999},"min":{"1min":0.20000000000000001,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.36899999999999999,"5min":0.42399999999999999,"15min":0.45100000000000001},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.23599999999999999,"5min":0.23699999999999999,"15min":0.23799999999999999},"min":{"1min":0.19600000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.35199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.251}]}]},{"osd":1,"up_from":8,"seq":34359740739,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20899999999999999},"min":{"1min":0.14399999999999999,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.38900000000000001,"5min":0.39100000000000001,"15min":0.40600000000000003},"last":0.17000000000000001},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.26100000000000001,"15min":0.26500000000000001},"min":{"1min":0.18099999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.40799999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.26500000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.23599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"min":{"1min":0.184,"5min":0.156,"15min":0.156},"max":{"1min":0.38300000000000001,"5min":0.42699999999999999,"15min":0.47499999999999998},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.26300000000000001},"min":{"1min":0.20100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.435,"5min":0.46500000000000002,"15min":0.499},"last":0.22900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:38:00.757 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:00.757 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:00.757 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:00.757 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:00.758 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:00.758 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:00.758 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:38:00.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:00.899+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:01.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:01.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:01.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:01.898+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:02.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:02.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:02.876 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:02.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:03.483 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:03.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:03.922 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:03.921+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:04.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:04.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:04.959 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:04.957+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:05.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:05.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:05.950 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:05.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:06.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:06.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:06.938 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:06.936+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:07.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:07.427+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:07.962 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:07.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:08.443 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:08.442+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:08.996 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:08.995+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:09.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:09.459+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:09.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:09.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:10.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:10.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:11.009 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:11.008+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:11.479 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:11.478+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:11.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:11.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:12.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:12.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:12.956 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:12.954+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:13.413 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:13.412+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:13.975 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:13.973+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:14.376 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:14.374+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:14.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:14.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:15.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:15.413+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:15.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:15.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:16.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:16.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:16.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:16.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:17.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:17.344+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:17.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:17.976+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:18.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:18.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:18.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:18.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:19.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:19.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:19.986 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:19.985+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:20.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:20.339+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:20.759 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:38:21.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:21.010+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:21.059 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:38:21.061 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:38:21.073 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6068,"stamp":"2023-12-06T07:38:20.237517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001911"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740737,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.22800000000000001,"15min":0.22500000000000001},"min":{"1min":0.16400000000000001,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.32500000000000001,"5min":0.439,"15min":0.501},"last":0.157},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.27200000000000002,"15min":0.26800000000000002},"min":{"1min":0.219,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.30199999999999999,"5min":0.44800000000000001,"15min":0.51400000000000001},"last":0.215}]},{"osd":1,"last update":"Wed Dec 6 07:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.23499999999999999,"15min":0.23200000000000001},"min":{"1min":0.17299999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.26700000000000002,"5min":0.44,"15min":0.47099999999999997},"last":0.16500000000000001},{"interface":"front","average":{"1min":0.253,"5min":0.26800000000000002,"15min":0.26400000000000001},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.30399999999999999,"5min":0.45200000000000001,"15min":0.50600000000000001},"last":0.20399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740738,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.20499999999999999,"5min":0.20799999999999999,"15min":0.20999999999999999},"min":{"1min":0.14199999999999999,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.32500000000000001,"5min":0.439,"15min":0.63400000000000001},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.21199999999999999,"5min":0.20100000000000001,"15min":0.18099999999999999},"max":{"1min":0.39700000000000002,"5min":0.45700000000000002,"15min":0.64600000000000002},"last":0.223}]},{"osd":2,"last update":"Wed Dec 6 07:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.23799999999999999,"5min":0.24399999999999999,"15min":0.23499999999999999},"min":{"1min":0.20000000000000001,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.36899999999999999,"5min":0.42399999999999999,"15min":0.45100000000000001},"last":0.193},{"interface":"front","average":{"1min":0.23599999999999999,"5min":0.23699999999999999,"15min":0.23799999999999999},"min":{"1min":0.19600000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.35199999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.20899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740743,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.224,"5min":0.20999999999999999,"15min":0.20899999999999999},"min":{"1min":0.14399999999999999,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.38900000000000001,"5min":0.39100000000000001,"15min":0.40600000000000003},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.26500000000000001,"5min":0.26100000000000001,"15min":0.26500000000000001},"min":{"1min":0.18099999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.40799999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"last":0.26400000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:37:28 2023","interfaces":[{"interface":"back","average":{"1min":0.23599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"min":{"1min":0.184,"5min":0.156,"15min":0.156},"max":{"1min":0.38300000000000001,"5min":0.42699999999999999,"15min":0.47499999999999998},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26000000000000001,"15min":0.26300000000000001},"min":{"1min":0.20100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.435,"5min":0.46500000000000002,"15min":0.499},"last":0.23599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:38:21.075 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:21.075 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:21.075 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:21.075 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:21.075 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:21.076 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:21.076 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:38:21.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:21.365+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:21.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:21.970+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:22.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:22.389+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:22.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:22.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:23.386 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:23.384+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:23.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:23.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:24.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:24.377+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:24.953 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:24.952+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:25.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:25.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:25.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:25.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:26.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:26.361+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:26.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:26.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:27.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:27.410+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:27.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:27.887+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:28.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:28.403+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:28.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:28.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:29.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:29.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:29.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:29.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:30.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:30.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:30.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:30.860+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:31.456 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:31.456+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:31.839 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:31.838+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:32.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:32.424+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:32.806 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:32.806+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:33.389 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:33.388+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:33.782 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:33.782+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:34.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:34.342+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:34.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:34.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:35.317 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:35.317+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:35.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:35.745+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:36.306 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:36.306+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:36.711 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:36.711+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:37.330 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:37.330+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:37.682 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:37.682+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:38.323 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:38.322+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:38.719 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:38.718+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:39.346 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:39.345+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:39.752 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:39.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:40.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:40.392+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:40.751 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:40.749+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:41.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:38:41.374 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:41.373+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:41.386 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:38:41.388 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:38:41.398 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6078,"stamp":"2023-12-06T07:38:40.240452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001800"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740741,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.22800000000000001,"15min":0.22500000000000001},"min":{"1min":0.16400000000000001,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.32500000000000001,"5min":0.439,"15min":0.501},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.27200000000000002,"15min":0.26800000000000002},"min":{"1min":0.219,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.30199999999999999,"5min":0.44800000000000001,"15min":0.51400000000000001},"last":0.22600000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:37:51 2023","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.23499999999999999,"15min":0.23200000000000001},"min":{"1min":0.17299999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.26700000000000002,"5min":0.44,"15min":0.47099999999999997},"last":0.20100000000000001},{"interface":"front","average":{"1min":0.253,"5min":0.26800000000000002,"15min":0.26400000000000001},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.30399999999999999,"5min":0.45200000000000001,"15min":0.50600000000000001},"last":0.23699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740742,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.20899999999999999,"15min":0.20999999999999999},"min":{"1min":0.16700000000000001,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.40600000000000003,"5min":0.439,"15min":0.63400000000000001},"last":0.185},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.184},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.27400000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.24299999999999999,"15min":0.23599999999999999},"min":{"1min":0.193,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.245},{"interface":"front","average":{"1min":0.247,"5min":0.23899999999999999,"15min":0.23799999999999999},"min":{"1min":0.20100000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.39000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.29099999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740747,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.20799999999999999},"min":{"1min":0.14399999999999999,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.182},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26500000000000001},"min":{"1min":0.21099999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.27800000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23499999999999999,"15min":0.23300000000000001},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.219},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.46000000000000002,"5min":0.46500000000000002,"15min":0.499},"last":0.249}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:38:41.400 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:41.400 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:41.400 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:41.400 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:41.400 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:41.401 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:38:41.401 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:38:41.745 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:41.743+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:42.370 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:42.369+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:42.762 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:42.761+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:43.418 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:43.416+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:43.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:43.809+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:44.426 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:44.425+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:44.784 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:44.783+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:45.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:45.415+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:45.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:45.808+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:46.403 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:46.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:46.795 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:46.794+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:47.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:47.359+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:47.804 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:47.803+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:48.330 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:48.329+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:48.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:48.846+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:49.364 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:49.363+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:49.859 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:49.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:50.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:50.349+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:50.861 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:50.859+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:51.362 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:51.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:51.888 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:51.886+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:52.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:52.365+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:52.840 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:52.839+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:53.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:53.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:53.877 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:53.876+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:54.332 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:54.330+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:54.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:54.881+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:55.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:55.293+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:55.898 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:55.896+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:56.291 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:56.289+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:56.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:56.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:57.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:57.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:57.929 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:57.928+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:58.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:58.255+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:58.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:58.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:59.274 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:38:59.273+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:38:59.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:38:59.913+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:00.242 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:00.240+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:00.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:00.909+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:01.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:01.272+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:01.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:39:01.702 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:39:01.703 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:39:01.714 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6088,"stamp":"2023-12-06T07:39:00.244192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002230"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740745,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.22500000000000001,"15min":0.224},"min":{"1min":0.154,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.311,"5min":0.439,"15min":0.501},"last":0.218},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26700000000000002,"15min":0.26900000000000002},"min":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.376,"5min":0.44800000000000001,"15min":0.51400000000000001},"last":0.23699999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23200000000000001},"min":{"1min":0.16500000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.32400000000000001,"5min":0.40600000000000003,"15min":0.47099999999999997},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26300000000000001,"15min":0.26400000000000001},"min":{"1min":0.19400000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.35399999999999998,"5min":0.45200000000000001,"15min":0.50600000000000001},"last":0.22700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740746,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.20899999999999999,"15min":0.20999999999999999},"min":{"1min":0.16700000000000001,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.40600000000000003,"5min":0.439,"15min":0.63400000000000001},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.184},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.32900000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.24299999999999999,"15min":0.23599999999999999},"min":{"1min":0.193,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.247,"5min":0.23899999999999999,"15min":0.23799999999999999},"min":{"1min":0.20100000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.39000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.26700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740751,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.20799999999999999},"min":{"1min":0.14399999999999999,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.22500000000000001},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26500000000000001},"min":{"1min":0.21099999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.308}]},{"osd":2,"last update":"Wed Dec 6 07:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23499999999999999,"15min":0.23300000000000001},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.248},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.46000000000000002,"5min":0.46500000000000002,"15min":0.499},"last":0.28100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:39:01.715 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:01.716 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:01.716 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:01.716 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:01.716 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:01.716 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:01.716 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:39:01.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:01.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:02.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:02.293+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:02.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:02.956+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:03.327 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:03.326+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:03.955 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:03.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:04.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:04.333+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:04.917 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:04.916+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:05.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:05.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:05.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:05.874+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:06.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:06.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:06.858 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:06.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:07.367 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:07.366+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:07.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:07.848+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:08.372 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:08.371+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:08.868 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:08.867+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:09.347 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:09.346+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:09.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:09.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:10.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:10.315+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:10.860 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:10.858+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:11.359 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:11.358+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:11.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:11.864+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:12.378 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:12.377+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:12.893 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:12.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:13.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:13.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:13.869 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:13.868+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:14.379 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:14.379+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:14.837 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:14.836+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:15.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:15.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:15.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:15.847+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:16.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:16.399+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:16.871 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:16.871+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:17.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:17.364+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:17.882 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:17.881+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:18.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:18.339+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:18.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:18.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:19.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:19.335+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:19.865 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:19.865+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:20.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:20.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:20.897 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:20.897+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:21.381 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:21.381+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:21.718 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:39:21.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:21.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:22.038 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:39:22.040 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:39:22.054 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6098,"stamp":"2023-12-06T07:39:20.247400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001960"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740749,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.22500000000000001,"15min":0.224},"min":{"1min":0.154,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.311,"5min":0.439,"15min":0.501},"last":0.255},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26700000000000002,"15min":0.26900000000000002},"min":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.376,"5min":0.44800000000000001,"15min":0.51400000000000001},"last":0.26300000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23200000000000001},"min":{"1min":0.16500000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.32400000000000001,"5min":0.40600000000000003,"15min":0.47099999999999997},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26300000000000001,"15min":0.26400000000000001},"min":{"1min":0.19400000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.35399999999999998,"5min":0.45200000000000001,"15min":0.50600000000000001},"last":0.27500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740750,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.20899999999999999,"15min":0.20999999999999999},"min":{"1min":0.16700000000000001,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.40600000000000003,"5min":0.439,"15min":0.63400000000000001},"last":0.16300000000000001},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.223,"5min":0.20100000000000001,"15min":0.184},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.254}]},{"osd":2,"last update":"Wed Dec 6 07:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.24299999999999999,"15min":0.23599999999999999},"min":{"1min":0.193,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.247,"5min":0.23899999999999999,"15min":0.23799999999999999},"min":{"1min":0.20100000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.39000000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"last":0.23999999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740755,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.21199999999999999,"5min":0.20999999999999999,"15min":0.20799999999999999},"min":{"1min":0.14399999999999999,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.17899999999999999},{"interface":"front","average":{"1min":0.28399999999999997,"5min":0.26600000000000001,"15min":0.26500000000000001},"min":{"1min":0.21099999999999999,"5min":0.17199999999999999,"15min":0.17199999999999999},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.24299999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23499999999999999,"15min":0.23300000000000001},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.46000000000000002,"5min":0.46500000000000002,"15min":0.499},"last":0.28899999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:39:22.055 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:22.056 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:22.056 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:22.056 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:22.057 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:22.057 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:22.057 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-12-06T07:39:22.362 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-12-06T07:39:22.373 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-12-06T07:39:22.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:22.430+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:22.681 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-12-06T07:39:22.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-12-06T07:39:22.960 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:22.960+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:23.003 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-12-06T07:39:23.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-12-06T07:39:23.345 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-12-06T07:39:23.357 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-12-06T07:39:23.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:23.419+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:23.702 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-12-06T07:39:23.714 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-12-06T07:39:23.933 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:23.932+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:24.043 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-12-06T07:39:24.055 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:39:24.453 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:24.452+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:24.939 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:24.938+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:25.461 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:25.460+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:25.900 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:25.899+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:26.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:26.466+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:26.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:26.909+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:27.489 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:27.488+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:27.928 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:27.927+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:28.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:28.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:28.961 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:28.959+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:29.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:29.476+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:29.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:29.940+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:30.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:30.462+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:30.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:30.944+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:31.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:31.416+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:31.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:31.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:32.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:32.448+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:32.935 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:32.934+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:33.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:33.431+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:33.902 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:33.900+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:34.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:34.446+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:34.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:34.882+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:35.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:35.489+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:35.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:35.844+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:36.467 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:36.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:36.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:36.826+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:37.498 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:37.496+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:37.802 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:37.801+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:38.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:38.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:38.809 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:38.808+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:39.511 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:39.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:39.825 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:39.824+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:40.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:40.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:40.786 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:40.785+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:41.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:41.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:41.815 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:41.814+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:42.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:42.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:42.767 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:42.765+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:43.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:43.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:43.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:43.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:44.056 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:39:44.354 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:39:44.356 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:39:44.367 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6110,"stamp":"2023-12-06T07:39:44.250963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001911"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740754,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.22500000000000001,"15min":0.224},"min":{"1min":0.154,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.311,"5min":0.439,"15min":0.501},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.26700000000000002,"15min":0.26900000000000002},"min":{"1min":0.20999999999999999,"5min":0.20799999999999999,"15min":0.188},"max":{"1min":0.376,"5min":0.44800000000000001,"15min":0.51400000000000001},"last":0.222}]},{"osd":1,"last update":"Wed Dec 6 07:38:52 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23200000000000001},"min":{"1min":0.16500000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.32400000000000001,"5min":0.40600000000000003,"15min":0.47099999999999997},"last":0.17699999999999999},{"interface":"front","average":{"1min":0.26100000000000001,"5min":0.26300000000000001,"15min":0.26400000000000001},"min":{"1min":0.19400000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.35399999999999998,"5min":0.45200000000000001,"15min":0.50600000000000001},"last":0.21099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740755,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.20100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.14699999999999999,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.28100000000000003,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.157},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.26700000000000002},"min":{"1min":0.218,"5min":0.20100000000000001,"15min":0.184},"max":{"1min":0.36199999999999999,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.23000000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"min":{"1min":0.188,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.315,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.248,"5min":0.23999999999999999,"15min":0.23899999999999999},"min":{"1min":0.20300000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.34999999999999998,"5min":0.39000000000000001,"15min":0.42899999999999999},"last":0.21199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740760,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.21099999999999999,"15min":0.20699999999999999},"min":{"1min":0.13300000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.308,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.16200000000000001},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.26900000000000002,"15min":0.26500000000000001},"min":{"1min":0.183,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.38,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.249}]},{"osd":2,"last update":"Wed Dec 6 07:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"min":{"1min":0.16400000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.33700000000000002,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26500000000000001},"min":{"1min":0.20200000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35999999999999999,"5min":0.46500000000000002,"15min":0.499},"last":0.23000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:39:44.368 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:44.369 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:44.369 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:44.369 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:44.369 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:44.369 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:39:44.370 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:39:44.485 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:44.483+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:44.789 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:44.787+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:45.482 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:45.481+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:45.794 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:45.793+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:46.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:46.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:46.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:46.821+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:47.545 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:47.544+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:47.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:47.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:48.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:48.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:48.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:48.809+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:49.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:49.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:49.844 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:49.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:50.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:50.531+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:50.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:50.850+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:51.491 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:51.490+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:51.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:51.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:52.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:52.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:52.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:52.826+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:53.436 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:53.435+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:53.814 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:53.813+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:54.451 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:54.450+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:54.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:54.822+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:55.462 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:55.461+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:55.850 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:55.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:56.450 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:56.449+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:56.846 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:56.846+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:57.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:57.465+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:57.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:57.884+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:58.484 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:58.484+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:58.870 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:58.870+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:59.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:39:59.500+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:39:59.913 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:39:59.913+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:00.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:00.536+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:00.873 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:00.872+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:01.533 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:01.532+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:01.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:01.834+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:02.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:02.568+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:02.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:02.856+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:03.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:03.570+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:03.834 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:03.834+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:04.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:40:04.544 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:04.543+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:04.705 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:40:04.707 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:40:04.718 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6120,"stamp":"2023-12-06T07:40:04.254219+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002067"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740758,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.224},"min":{"1min":0.16200000000000001,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.42599999999999999,"5min":0.439,"15min":0.501},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":0.498,"5min":0.498,"15min":0.51400000000000001},"last":0.251}]},{"osd":1,"last update":"Wed Dec 6 07:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23599999999999999,"5min":0.23100000000000001,"15min":0.23200000000000001},"min":{"1min":0.17699999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.47099999999999997},"last":0.246},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26300000000000001},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.50600000000000001},"last":0.27100000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740759,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.20100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.14699999999999999,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.28100000000000003,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.26700000000000002},"min":{"1min":0.218,"5min":0.20100000000000001,"15min":0.184},"max":{"1min":0.36199999999999999,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.23899999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"min":{"1min":0.188,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.315,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.248,"5min":0.23999999999999999,"15min":0.23899999999999999},"min":{"1min":0.20300000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.34999999999999998,"5min":0.39000000000000001,"15min":0.42899999999999999},"last":0.223}]}]},{"osd":1,"up_from":8,"seq":34359740764,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.21099999999999999,"15min":0.20699999999999999},"min":{"1min":0.13300000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.308,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.17199999999999999},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.26900000000000002,"15min":0.26500000000000001},"min":{"1min":0.183,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.38,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.255}]},{"osd":2,"last update":"Wed Dec 6 07:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"min":{"1min":0.16400000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.33700000000000002,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26500000000000001},"min":{"1min":0.20200000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35999999999999999,"5min":0.46500000000000002,"15min":0.499},"last":0.28499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:40:04.719 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:04.719 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:04.719 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:04.720 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:04.720 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:04.720 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:04.720 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:40:04.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:04.800+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:05.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:05.499+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:05.753 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:05.752+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:06.470 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:06.469+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:06.723 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:06.721+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:07.514 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:07.512+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:07.750 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:07.748+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:08.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:08.545+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:08.708 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:08.707+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:09.522 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:09.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:09.677 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:09.676+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:10.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:10.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:10.690 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:10.689+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:11.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:11.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:11.689 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:11.688+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:12.459 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:12.457+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:12.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:12.727+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:13.488 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:13.486+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:13.766 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:13.764+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:14.474 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:14.473+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:14.743 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:14.742+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:15.512 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:15.510+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:15.748 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:15.747+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:16.523 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:16.521+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:16.763 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:16.762+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:17.499 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:17.497+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:17.800 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:17.798+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:18.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:18.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:18.776 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:18.775+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:19.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:19.561+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:19.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:19.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:20.568 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:20.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:20.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:20.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:21.616 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:21.615+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:21.742 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:21.741+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:22.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:22.619+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:22.770 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:22.769+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:23.654 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:23.653+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:23.733 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:23.730+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:24.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:24.695+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:24.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:24.716+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:24.721 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:40:25.070 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:40:25.072 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:40:25.084 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6130,"stamp":"2023-12-06T07:40:24.257324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001856"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740762,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.224},"min":{"1min":0.16200000000000001,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.42599999999999999,"5min":0.439,"15min":0.501},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":0.498,"5min":0.498,"15min":0.51400000000000001},"last":0.248}]},{"osd":1,"last update":"Wed Dec 6 07:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23599999999999999,"5min":0.23100000000000001,"15min":0.23200000000000001},"min":{"1min":0.17699999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.47099999999999997},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26300000000000001},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.50600000000000001},"last":0.23300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740763,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.20100000000000001,"5min":0.20799999999999999,"15min":0.20799999999999999},"min":{"1min":0.14699999999999999,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.28100000000000003,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.26900000000000002,"15min":0.26700000000000002},"min":{"1min":0.218,"5min":0.20100000000000001,"15min":0.184},"max":{"1min":0.36199999999999999,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.219}]},{"osd":2,"last update":"Wed Dec 6 07:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.23999999999999999,"5min":0.24099999999999999,"15min":0.23599999999999999},"min":{"1min":0.188,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.315,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.191},{"interface":"front","average":{"1min":0.248,"5min":0.23999999999999999,"15min":0.23899999999999999},"min":{"1min":0.20300000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.34999999999999998,"5min":0.39000000000000001,"15min":0.42899999999999999},"last":0.19900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740768,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.21099999999999999,"15min":0.20699999999999999},"min":{"1min":0.13300000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.308,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.151},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.26900000000000002,"15min":0.26500000000000001},"min":{"1min":0.183,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.38,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.23699999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:39:35 2023","interfaces":[{"interface":"back","average":{"1min":0.24199999999999999,"5min":0.23899999999999999,"15min":0.23400000000000001},"min":{"1min":0.16400000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.33700000000000002,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.216},{"interface":"front","average":{"1min":0.27800000000000002,"5min":0.26800000000000002,"15min":0.26500000000000001},"min":{"1min":0.20200000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.35999999999999999,"5min":0.46500000000000002,"15min":0.499},"last":0.25700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:40:25.086 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:25.086 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:25.086 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:25.087 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:25.087 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:25.087 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:25.087 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:40:25.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:25.667+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:25.691 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:25.689+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:26.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:26.658+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:26.729 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:26.728+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:27.637 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:27.636+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:27.740 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:27.739+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:28.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:28.658+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:28.704 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:28.703+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:29.616 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:29.615+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:29.685 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:29.683+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:30.571 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:30.570+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:30.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:30.635+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:31.570 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:31.568+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:31.671 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:31.670+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:32.585 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:32.584+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:32.688 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:32.687+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:33.584 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:33.583+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:33.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:33.659+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:34.612 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:34.610+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:34.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:34.618+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:35.599 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:35.597+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:35.617 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:35.615+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:36.581 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:36.580+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:36.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:36.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:37.613 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:37.612+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:37.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:37.658+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:38.651 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:38.650+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:38.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:38.678+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:39.681 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:39.681+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:39.723 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:39.723+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:40.668 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:40.667+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:40.710 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:40.710+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:41.625 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:41.624+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:41.737 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:41.737+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:42.649 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:42.649+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:42.743 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:42.743+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:43.692 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:43.691+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:43.729 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:43.729+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:44.687 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:44.687+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:44.764 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:44.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:45.089 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:40:45.386 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:40:45.388 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:40:45.399 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6140,"stamp":"2023-12-06T07:40:44.260047+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001680"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740766,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.224},"min":{"1min":0.16200000000000001,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.42599999999999999,"5min":0.439,"15min":0.501},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.26900000000000002,"15min":0.26900000000000002},"min":{"1min":0.219,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":0.498,"5min":0.498,"15min":0.51400000000000001},"last":0.27200000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:39:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23599999999999999,"5min":0.23100000000000001,"15min":0.23200000000000001},"min":{"1min":0.17699999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.47099999999999997},"last":0.218},{"interface":"front","average":{"1min":0.26700000000000002,"5min":0.26400000000000001,"15min":0.26300000000000001},"min":{"1min":0.20799999999999999,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.50600000000000001},"last":0.248}]}]},{"osd":0,"up_from":8,"seq":34359740767,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.19800000000000001,"5min":0.20200000000000001,"15min":0.20599999999999999},"min":{"1min":0.14599999999999999,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.35199999999999998,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.184},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.40899999999999997,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.255}]},{"osd":2,"last update":"Wed Dec 6 07:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.24199999999999999,"15min":0.23599999999999999},"min":{"1min":0.191,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.374,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"min":{"1min":0.16300000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.38200000000000001,"5min":0.39000000000000001,"15min":0.42899999999999999},"last":0.23999999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740772,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.17999999999999999,"5min":0.20100000000000001,"15min":0.20499999999999999},"min":{"1min":0.13800000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.247,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26600000000000001,"15min":0.26500000000000001},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.31,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.29399999999999998}]},{"osd":2,"last update":"Wed Dec 6 07:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.29799999999999999,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.26400000000000001,"15min":0.26600000000000001},"min":{"1min":0.21299999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.33700000000000002,"5min":0.46000000000000002,"15min":0.499},"last":0.26300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:40:45.400 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:45.401 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:45.401 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:45.401 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:45.401 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:45.401 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:40:45.401 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:40:45.659 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:45.658+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:45.768 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:45.768+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:46.705 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:46.705+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:46.763 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:46.763+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:47.717 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:47.717+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:47.757 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:47.757+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:48.697 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:48.697+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:48.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:48.744+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:49.695 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:49.694+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:49.728 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:49.727+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:50.665 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:50.664+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:50.771 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:50.770+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:51.657 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:51.655+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:51.813 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:51.811+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:52.643 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:52.641+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:52.851 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:52.850+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:53.628 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:53.626+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:53.806 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:53.805+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:54.583 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:54.581+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:54.785 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:54.784+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:55.606 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:55.605+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:55.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:55.776+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:56.575 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:56.573+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:56.777 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:56.776+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:57.617 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:57.616+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:57.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:57.731+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:58.595 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:58.594+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:58.701 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:58.700+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:59.609 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:40:59.607+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:40:59.703 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:40:59.702+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:00.596 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:00.594+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:00.681 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:00.680+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:01.588 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:01.587+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:01.669 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:01.668+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:02.594 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:02.593+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:02.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:02.674+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:03.642 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:03.640+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:03.689 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:03.688+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:04.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:04.640+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:04.654 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:04.652+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:05.402 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:41:05.642 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:05.641+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:05.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:05.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:05.747 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:41:05.749 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:41:05.760 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6150,"stamp":"2023-12-06T07:41:04.262902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001697"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740770,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.22700000000000001,"15min":0.224},"min":{"1min":0.17000000000000001,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.501},"last":0.16700000000000001},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.26900000000000002},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":0.46100000000000002,"5min":0.498,"15min":0.51400000000000001},"last":0.24299999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.17899999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.42599999999999999,"5min":0.46200000000000002,"15min":0.47099999999999997},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.45200000000000001,"5min":0.48699999999999999,"15min":0.50600000000000001},"last":0.23100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740771,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.19800000000000001,"5min":0.20200000000000001,"15min":0.20599999999999999},"min":{"1min":0.14599999999999999,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.35199999999999998,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.246},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.40899999999999997,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.24199999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.24199999999999999,"15min":0.23599999999999999},"min":{"1min":0.191,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.374,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"min":{"1min":0.16300000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.38200000000000001,"5min":0.39000000000000001,"15min":0.42899999999999999},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740776,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.17999999999999999,"5min":0.20100000000000001,"15min":0.20499999999999999},"min":{"1min":0.13800000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.247,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.246},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26600000000000001,"15min":0.26500000000000001},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.31,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Wed Dec 6 07:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.29799999999999999,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.214},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.26400000000000001,"15min":0.26600000000000001},"min":{"1min":0.21299999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.33700000000000002,"5min":0.46000000000000002,"15min":0.499},"last":0.254}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:41:05.761 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:05.762 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:05.762 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:05.762 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:05.762 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:05.762 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:05.763 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:41:06.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:06.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:06.664 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:06.663+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:07.602 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:07.600+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:07.647 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:07.646+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:08.636 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:08.635+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:08.688 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:08.687+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:09.629 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:09.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:09.734 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:09.732+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:10.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:10.647+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:10.777 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:10.776+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:11.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:11.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:11.732 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:11.731+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:12.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:12.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:12.714 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:12.713+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:13.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:13.572+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:13.749 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:13.748+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:14.611 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:14.610+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:14.792 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:14.791+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:15.574 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:15.573+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:15.810 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:15.809+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:16.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:16.546+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:16.769 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:16.768+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:17.590 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:17.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:17.735 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:17.733+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:18.625 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:18.623+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:18.725 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:18.724+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:19.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:19.602+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:19.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:19.726+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:20.563 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:20.562+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:20.728 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:20.726+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:21.586 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:21.586+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:21.747 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:21.746+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:22.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:22.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:22.797 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:22.797+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:23.614 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:23.614+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:23.827 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:23.827+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:24.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:24.589+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:24.875 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:24.875+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:25.567 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:25.566+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:25.764 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:41:25.852 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:25.851+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:26.091 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:41:26.093 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:41:26.105 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6160,"stamp":"2023-12-06T07:41:24.265549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001624"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740774,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.22700000000000001,"15min":0.224},"min":{"1min":0.17000000000000001,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.501},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.26900000000000002},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":0.46100000000000002,"5min":0.498,"15min":0.51400000000000001},"last":0.26600000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.17899999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.42599999999999999,"5min":0.46200000000000002,"15min":0.47099999999999997},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.45200000000000001,"5min":0.48699999999999999,"15min":0.50600000000000001},"last":0.31}]}]},{"osd":0,"up_from":8,"seq":34359740775,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.19800000000000001,"5min":0.20200000000000001,"15min":0.20599999999999999},"min":{"1min":0.14599999999999999,"5min":0.13500000000000001,"15min":0.13500000000000001},"max":{"1min":0.35199999999999998,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.158},{"interface":"front","average":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.40899999999999997,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.23499999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:40:26 2023","interfaces":[{"interface":"back","average":{"1min":0.23899999999999999,"5min":0.24199999999999999,"15min":0.23599999999999999},"min":{"1min":0.191,"5min":0.17599999999999999,"15min":0.159},"max":{"1min":0.374,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"min":{"1min":0.16300000000000001,"5min":0.156,"15min":0.156},"max":{"1min":0.38200000000000001,"5min":0.39000000000000001,"15min":0.42899999999999999},"last":0.221}]}]},{"osd":1,"up_from":8,"seq":34359740780,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.17999999999999999,"5min":0.20100000000000001,"15min":0.20499999999999999},"min":{"1min":0.13800000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.247,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26600000000000001,"15min":0.26500000000000001},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.31,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.23400000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:40:38 2023","interfaces":[{"interface":"back","average":{"1min":0.22500000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"min":{"1min":0.18099999999999999,"5min":0.156,"15min":0.156},"max":{"1min":0.29799999999999999,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.26300000000000001,"5min":0.26400000000000001,"15min":0.26600000000000001},"min":{"1min":0.21299999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.33700000000000002,"5min":0.46000000000000002,"15min":0.499},"last":0.29599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:41:26.106 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:26.107 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:26.107 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:26.107 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:26.107 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:26.108 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:26.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-12-06T07:41:26.438 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-12-06T07:41:26.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-12-06T07:41:26.593 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:26.593+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:26.764 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-12-06T07:41:26.774 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-12-06T07:41:26.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:26.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:27.076 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-12-06T07:41:27.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-12-06T07:41:27.456 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-12-06T07:41:27.467 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-12-06T07:41:27.579 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:27.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:27.811 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-12-06T07:41:27.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-12-06T07:41:27.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:27.849+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:28.128 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-12-06T07:41:28.140 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:41:28.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:28.568+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:28.845 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:28.844+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:29.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:29.557+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:29.857 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:29.857+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:30.571 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:30.571+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:30.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:30.823+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:31.600 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:31.600+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:31.823 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:31.823+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:32.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:32.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:32.849 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:32.848+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:33.583 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:33.581+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:33.801 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:33.800+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:34.607 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:34.606+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:34.812 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:34.811+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:35.623 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:35.621+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:35.798 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:35.797+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:36.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:36.588+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:36.835 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:36.834+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:37.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:37.604+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:37.817 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:37.816+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:38.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:38.630+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:38.847 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:38.846+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:39.626 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:39.624+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:39.881 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:39.880+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:40.588 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:40.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:40.894 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:40.893+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:41.595 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:41.594+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:41.911 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:41.909+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:42.599 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:42.598+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:42.951 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:42.950+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:43.645 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:43.644+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:44.000 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:43.998+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:44.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:44.608+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:44.977 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:44.975+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:45.619 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:45.617+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:45.998 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:45.996+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:46.573 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:46.572+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:47.045 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:47.043+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:47.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:47.527+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:48.047 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:48.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:48.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:41:48.467 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:41:48.469 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:41:48.481 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6172,"stamp":"2023-12-06T07:41:48.269561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002101"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740779,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.22700000000000001,"15min":0.224},"min":{"1min":0.17000000000000001,"5min":0.14999999999999999,"15min":0.13700000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.501},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.26900000000000002},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.188},"max":{"1min":0.46100000000000002,"5min":0.498,"15min":0.51400000000000001},"last":0.28799999999999998}]},{"osd":1,"last update":"Wed Dec 6 07:40:54 2023","interfaces":[{"interface":"back","average":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.17899999999999999,"5min":0.161,"15min":0.161},"max":{"1min":0.42599999999999999,"5min":0.46200000000000002,"15min":0.47099999999999997},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.26200000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"min":{"1min":0.20200000000000001,"5min":0.186,"15min":0.17100000000000001},"max":{"1min":0.45200000000000001,"5min":0.48699999999999999,"15min":0.50600000000000001},"last":0.30299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740780,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.19800000000000001,"5min":0.20300000000000001,"15min":0.20399999999999999},"min":{"1min":0.156,"5min":0.14199999999999999,"15min":0.13500000000000001},"max":{"1min":0.25700000000000001,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26800000000000002,"15min":0.26700000000000002},"min":{"1min":0.218,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.29699999999999999,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.28100000000000003}]},{"osd":2,"last update":"Wed Dec 6 07:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23999999999999999,"15min":0.23599999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.30399999999999999,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.24199999999999999,"15min":0.23799999999999999},"min":{"1min":0.20599999999999999,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.28499999999999998,"5min":0.39000000000000001,"15min":0.42899999999999999},"last":0.26900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740785,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.20100000000000001,"15min":0.20499999999999999},"min":{"1min":0.14000000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.32200000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.158},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.22900000000000001,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.38700000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.27500000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.19,"5min":0.16400000000000001,"15min":0.156},"max":{"1min":0.33300000000000002,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.20399999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.17999999999999999},"max":{"1min":0.36299999999999999,"5min":0.46000000000000002,"15min":0.499},"last":0.24199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:41:48.482 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:48.482 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:48.483 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:48.483 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:48.483 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:48.483 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:41:48.483 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:41:48.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:48.485+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:49.027 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:49.025+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:49.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:49.448+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:50.002 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:50.001+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:50.475 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:50.474+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:50.958 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:50.957+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:51.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:51.505+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:51.954 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:51.953+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:52.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:52.517+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:52.984 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:52.982+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:53.518 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:53.516+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:53.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:53.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:54.524 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:54.523+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:54.918 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:54.917+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:55.519 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:55.518+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:55.965 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:55.964+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:56.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:56.502+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:56.942 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:56.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:57.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:57.525+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:57.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:57.935+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:58.527 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:58.526+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:58.946 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:58.945+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:59.481 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:41:59.480+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:41:59.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:41:59.931+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:00.440 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:00.439+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:00.910 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:00.909+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:01.419 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:01.418+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:01.914 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:01.913+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:02.393 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:02.391+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:02.940 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:02.939+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:03.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:03.349+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:03.974 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:03.973+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:04.318 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:04.316+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:04.983 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:04.983+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:05.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:05.348+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:05.949 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:05.949+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:06.351 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:06.351+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:06.941 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:06.941+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:07.341 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:07.341+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:07.936 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:07.936+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:08.388 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:08.387+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:08.484 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:42:08.817 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:42:08.819 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:42:08.829 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6182,"stamp":"2023-12-06T07:42:08.272713+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001960"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740783,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.22,"15min":0.222},"min":{"1min":0.14699999999999999,"5min":0.14699999999999999,"15min":0.13700000000000001},"max":{"1min":0.27200000000000002,"5min":0.46899999999999997,"15min":0.501},"last":0.14499999999999999},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.26300000000000001,"15min":0.26700000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.28799999999999998,"5min":0.498,"15min":0.50900000000000001},"last":0.20599999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.22600000000000001,"15min":0.23000000000000001},"min":{"1min":0.17299999999999999,"5min":0.16500000000000001,"15min":0.161},"max":{"1min":0.27800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.155},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.25700000000000001,"15min":0.26200000000000001},"min":{"1min":0.19700000000000001,"5min":0.19400000000000001,"15min":0.17100000000000001},"max":{"1min":0.31,"5min":0.48699999999999999,"15min":0.48999999999999999},"last":0.18099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740784,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.19800000000000001,"5min":0.20300000000000001,"15min":0.20399999999999999},"min":{"1min":0.156,"5min":0.14199999999999999,"15min":0.13500000000000001},"max":{"1min":0.25700000000000001,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26800000000000002,"15min":0.26700000000000002},"min":{"1min":0.218,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.29699999999999999,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.248}]},{"osd":2,"last update":"Wed Dec 6 07:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23999999999999999,"15min":0.23599999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.30399999999999999,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.20200000000000001},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.24199999999999999,"15min":0.23799999999999999},"min":{"1min":0.20599999999999999,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.28499999999999998,"5min":0.39000000000000001,"15min":0.42899999999999999},"last":0.23499999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740789,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.20100000000000001,"15min":0.20499999999999999},"min":{"1min":0.14000000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.32200000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.216},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.22900000000000001,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.38700000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.26700000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.19,"5min":0.16400000000000001,"15min":0.156},"max":{"1min":0.33300000000000002,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.17999999999999999},"max":{"1min":0.36299999999999999,"5min":0.46000000000000002,"15min":0.499},"last":0.23699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:42:08.831 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:08.831 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:08.831 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:08.831 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:08.831 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:08.831 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:08.832 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:42:08.909 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:08.908+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:09.348 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:09.347+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:09.891 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:09.891+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:10.360 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:10.360+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:10.878 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:10.878+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:11.321 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:11.321+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:11.899 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:11.899+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:12.278 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:12.278+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:12.889 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:12.889+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:13.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:13.234+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:13.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:13.843+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:14.250 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:14.249+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:14.805 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:14.805+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:15.217 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:15.217+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:15.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:15.843+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:16.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:16.191+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:16.883 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:16.882+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:17.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:17.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:17.843 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:17.842+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:18.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:18.138+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:18.884 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:18.883+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:19.186 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:19.185+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:19.932 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:19.931+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:20.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:20.192+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:20.947 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:20.946+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:21.175 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:21.174+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:21.971 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:21.969+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:22.202 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:22.200+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:22.993 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:22.992+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:23.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:23.245+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:24.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:24.024+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:24.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:24.248+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:25.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:25.067+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:25.236 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:25.235+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:26.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:26.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:26.190 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:26.189+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:27.052 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:27.051+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:27.161 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:27.160+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:28.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:28.070+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:28.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:28.182+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:28.833 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:42:29.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:29.093+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:29.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:29.169+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:29.172 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:42:29.175 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:42:29.186 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6192,"stamp":"2023-12-06T07:42:28.275879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001934"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740787,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.22,"15min":0.222},"min":{"1min":0.14699999999999999,"5min":0.14699999999999999,"15min":0.13700000000000001},"max":{"1min":0.27200000000000002,"5min":0.46899999999999997,"15min":0.501},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.26300000000000001,"15min":0.26700000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.28799999999999998,"5min":0.498,"15min":0.50900000000000001},"last":0.23499999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.22600000000000001,"15min":0.23000000000000001},"min":{"1min":0.17299999999999999,"5min":0.16500000000000001,"15min":0.161},"max":{"1min":0.27800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.19600000000000001},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.25700000000000001,"15min":0.26200000000000001},"min":{"1min":0.19700000000000001,"5min":0.19400000000000001,"15min":0.17100000000000001},"max":{"1min":0.31,"5min":0.48699999999999999,"15min":0.48999999999999999},"last":0.223}]}]},{"osd":0,"up_from":8,"seq":34359740788,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.19800000000000001,"5min":0.20300000000000001,"15min":0.20399999999999999},"min":{"1min":0.156,"5min":0.14199999999999999,"15min":0.13500000000000001},"max":{"1min":0.25700000000000001,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.16900000000000001},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26800000000000002,"15min":0.26700000000000002},"min":{"1min":0.218,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.29699999999999999,"5min":0.45400000000000001,"15min":0.64600000000000002},"last":0.25700000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:41:28 2023","interfaces":[{"interface":"back","average":{"1min":0.23000000000000001,"5min":0.23999999999999999,"15min":0.23599999999999999},"min":{"1min":0.17199999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.30399999999999999,"5min":0.41999999999999998,"15min":0.45100000000000001},"last":0.224},{"interface":"front","average":{"1min":0.24099999999999999,"5min":0.24199999999999999,"15min":0.23799999999999999},"min":{"1min":0.20599999999999999,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.28499999999999998,"5min":0.39000000000000001,"15min":0.42899999999999999},"last":0.23499999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740793,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.19500000000000001,"5min":0.20100000000000001,"15min":0.20499999999999999},"min":{"1min":0.14000000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.32200000000000001,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.159},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.22900000000000001,"5min":0.18099999999999999,"15min":0.17199999999999999},"max":{"1min":0.38700000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.23200000000000001}]},{"osd":2,"last update":"Wed Dec 6 07:41:42 2023","interfaces":[{"interface":"back","average":{"1min":0.23400000000000001,"5min":0.23599999999999999,"15min":0.23499999999999999},"min":{"1min":0.19,"5min":0.16400000000000001,"15min":0.156},"max":{"1min":0.33300000000000002,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.17399999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.26700000000000002},"min":{"1min":0.221,"5min":0.20100000000000001,"15min":0.17999999999999999},"max":{"1min":0.36299999999999999,"5min":0.46000000000000002,"15min":0.499},"last":0.20799999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:42:29.188 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:29.188 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:29.188 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:29.188 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:29.189 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:29.189 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:29.189 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:42:30.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:30.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:30.200 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:30.198+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:31.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:31.072+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:31.235 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:31.234+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:32.035 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:32.034+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:32.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:32.246+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:33.010 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:33.009+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:33.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:33.236+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:34.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:34.010+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:34.261 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:34.260+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:35.043 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:35.042+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:35.254 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:35.253+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:36.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:36.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:36.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:36.225+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:37.110 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:37.108+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:37.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:37.222+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:38.075 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:38.074+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:38.206 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:38.205+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:39.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:39.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:39.195 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:39.194+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:40.067 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:40.066+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:40.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:40.242+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:41.111 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:41.110+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:41.207 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:41.206+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:42.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:42.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:42.168 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:42.166+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:43.107 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:43.106+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:43.155 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:43.154+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:44.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:44.128+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:44.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:44.168+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:45.120 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:45.119+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:45.121 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:45.120+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:46.131 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:46.130+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:46.160 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:46.159+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:47.105 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:47.104+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:47.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:47.204+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:48.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:48.129+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:48.252 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:48.251+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:49.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:49.144+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:49.190 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:42:49.288 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:49.288+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:49.526 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:42:49.528 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:42:49.540 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6202,"stamp":"2023-12-06T07:42:48.279140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002101"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740791,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.20799999999999999,"5min":0.22,"15min":0.222},"min":{"1min":0.14699999999999999,"5min":0.14699999999999999,"15min":0.13700000000000001},"max":{"1min":0.27200000000000002,"5min":0.46899999999999997,"15min":0.501},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.23999999999999999,"5min":0.26300000000000001,"15min":0.26700000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.28799999999999998,"5min":0.498,"15min":0.50900000000000001},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:41:54 2023","interfaces":[{"interface":"back","average":{"1min":0.21299999999999999,"5min":0.22600000000000001,"15min":0.23000000000000001},"min":{"1min":0.17299999999999999,"5min":0.16500000000000001,"15min":0.161},"max":{"1min":0.27800000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.24399999999999999,"5min":0.25700000000000001,"15min":0.26200000000000001},"min":{"1min":0.19700000000000001,"5min":0.19400000000000001,"15min":0.17100000000000001},"max":{"1min":0.31,"5min":0.48699999999999999,"15min":0.48999999999999999},"last":0.29199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740792,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20599999999999999},"min":{"1min":0.161,"5min":0.14599999999999999,"15min":0.13500000000000001},"max":{"1min":0.39900000000000002,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.16},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27000000000000002,"15min":0.26900000000000002},"min":{"1min":0.20999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.64600000000000002},"last":0.27600000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24099999999999999,"15min":0.23799999999999999},"min":{"1min":0.17699999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.248,"5min":0.24399999999999999,"15min":0.23999999999999999},"min":{"1min":0.19700000000000001,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.22700000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740797,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.19400000000000001,"15min":0.20399999999999999},"min":{"1min":0.151,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.27400000000000002,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.158},{"interface":"front","average":{"1min":0.254,"5min":0.26700000000000002,"15min":0.26600000000000001},"min":{"1min":0.20599999999999999,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":0.30399999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.249}]},{"osd":2,"last update":"Wed Dec 6 07:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.23200000000000001,"15min":0.23400000000000001},"min":{"1min":0.17399999999999999,"5min":0.16400000000000001,"15min":0.156},"max":{"1min":0.25,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.216},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.26600000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.17999999999999999},"max":{"1min":0.29299999999999998,"5min":0.46000000000000002,"15min":0.499},"last":0.27900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:42:49.541 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:49.541 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:49.541 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:49.542 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:49.542 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:49.542 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:42:49.542 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:42:50.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:50.126+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:50.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:50.303+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:51.090 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:51.089+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:51.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:51.255+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:52.118 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:52.118+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:52.276 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:52.276+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:53.144 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:53.143+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:53.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:53.297+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:54.181 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:54.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:54.339 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:54.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:55.142 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:55.142+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:55.298 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:55.298+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:56.162 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:56.162+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:56.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:56.338+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:57.183 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:57.182+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:57.350 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:57.350+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:58.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:58.216+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:58.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:58.342+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:59.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:42:59.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:42:59.366 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:42:59.365+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:00.276 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:00.275+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:00.399 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:00.398+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:01.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:01.245+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:01.447 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:01.445+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:02.246 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:02.245+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:02.410 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:02.409+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:03.198 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:03.197+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:03.377 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:03.376+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:04.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:04.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:04.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:04.353+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:05.253 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:05.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:05.402 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:05.401+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:06.263 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:06.262+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:06.437 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:06.436+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:07.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:07.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:07.465 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:07.464+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:08.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:08.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:08.502 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:08.501+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:09.251 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:09.249+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:09.544 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:43:09.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:09.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:09.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:43:09.853 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:43:09.863 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6212,"stamp":"2023-12-06T07:43:08.282244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001922"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740795,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.224},"min":{"1min":0.14499999999999999,"5min":0.14499999999999999,"15min":0.13700000000000001},"max":{"1min":0.44500000000000001,"5min":0.46899999999999997,"15min":0.501},"last":0.185},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.26900000000000002},"min":{"1min":0.20599999999999999,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.46300000000000002,"5min":0.498,"15min":0.50900000000000001},"last":0.23899999999999999}]},{"osd":1,"last update":"Wed Dec 6 07:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.26400000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17100000000000001},"max":{"1min":0.45400000000000001,"5min":0.48699999999999999,"15min":0.48999999999999999},"last":0.23000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740796,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20599999999999999},"min":{"1min":0.161,"5min":0.14599999999999999,"15min":0.13500000000000001},"max":{"1min":0.39900000000000002,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.222},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27000000000000002,"15min":0.26900000000000002},"min":{"1min":0.20999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.64600000000000002},"last":0.317}]},{"osd":2,"last update":"Wed Dec 6 07:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24099999999999999,"15min":0.23799999999999999},"min":{"1min":0.17699999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.248,"5min":0.24399999999999999,"15min":0.23999999999999999},"min":{"1min":0.19700000000000001,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.23300000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740801,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.19400000000000001,"15min":0.20399999999999999},"min":{"1min":0.151,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.27400000000000002,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.17499999999999999},{"interface":"front","average":{"1min":0.254,"5min":0.26700000000000002,"15min":0.26600000000000001},"min":{"1min":0.20599999999999999,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":0.30399999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.27100000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.23200000000000001,"15min":0.23400000000000001},"min":{"1min":0.17399999999999999,"5min":0.16400000000000001,"15min":0.156},"max":{"1min":0.25,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.23799999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.26600000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.17999999999999999},"max":{"1min":0.29299999999999998,"5min":0.46000000000000002,"15min":0.499},"last":0.29999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:43:09.864 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:09.865 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:09.865 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:09.865 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:09.865 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:09.865 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:09.866 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:43:10.222 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:10.221+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:10.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:10.564+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:11.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:11.239+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:11.516 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:11.515+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:12.229 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:12.227+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:12.549 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:12.548+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:13.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:13.251+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:13.500 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:13.499+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:14.303 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:14.302+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:14.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:14.528+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:15.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:15.283+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:15.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:15.547+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:16.239 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:16.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:16.596 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:16.595+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:17.196 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:17.195+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:17.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:17.637+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:18.241 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:18.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:18.684 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:18.683+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:19.285 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:19.283+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:19.689 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:19.688+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:20.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:20.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:20.694 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:20.693+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:21.275 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:21.274+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:21.665 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:21.664+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:22.310 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:22.309+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:22.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:22.647+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:23.293 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:23.292+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:23.627 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:23.626+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:24.247 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:24.246+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:24.613 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:24.612+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:25.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:25.207+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:25.614 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:25.613+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:26.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:26.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:26.594 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:26.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:27.210 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:27.209+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:27.637 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:27.636+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:28.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:28.206+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:28.612 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:28.611+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:29.172 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:29.170+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:29.635 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:29.635+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:29.867 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:43:30.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:30.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:30.159 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:43:30.161 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:43:30.172 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6222,"stamp":"2023-12-06T07:43:28.285656+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002040"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740799,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.224},"min":{"1min":0.14499999999999999,"5min":0.14499999999999999,"15min":0.13700000000000001},"max":{"1min":0.44500000000000001,"5min":0.46899999999999997,"15min":0.501},"last":0.20699999999999999},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.26900000000000002},"min":{"1min":0.20599999999999999,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.46300000000000002,"5min":0.498,"15min":0.50900000000000001},"last":0.28199999999999997}]},{"osd":1,"last update":"Wed Dec 6 07:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.247},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.26400000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17100000000000001},"max":{"1min":0.45400000000000001,"5min":0.48699999999999999,"15min":0.48999999999999999},"last":0.29499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740800,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20599999999999999},"min":{"1min":0.161,"5min":0.14599999999999999,"15min":0.13500000000000001},"max":{"1min":0.39900000000000002,"5min":0.40600000000000003,"15min":0.63400000000000001},"last":0.17299999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.27000000000000002,"15min":0.26900000000000002},"min":{"1min":0.20999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.64600000000000002},"last":0.25}]},{"osd":2,"last update":"Wed Dec 6 07:42:29 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.24099999999999999,"15min":0.23799999999999999},"min":{"1min":0.17699999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.223},{"interface":"front","average":{"1min":0.248,"5min":0.24399999999999999,"15min":0.23999999999999999},"min":{"1min":0.19700000000000001,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.20699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740805,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.188,"5min":0.19400000000000001,"15min":0.20399999999999999},"min":{"1min":0.151,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.27400000000000002,"5min":0.39500000000000002,"15min":0.39700000000000002},"last":0.17599999999999999},{"interface":"front","average":{"1min":0.254,"5min":0.26700000000000002,"15min":0.26600000000000001},"min":{"1min":0.20599999999999999,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":0.30399999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.222}]},{"osd":2,"last update":"Wed Dec 6 07:42:44 2023","interfaces":[{"interface":"back","average":{"1min":0.214,"5min":0.23200000000000001,"15min":0.23400000000000001},"min":{"1min":0.17399999999999999,"5min":0.16400000000000001,"15min":0.156},"max":{"1min":0.25,"5min":0.42799999999999999,"15min":0.47499999999999998},"last":0.189},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.26600000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.17999999999999999},"max":{"1min":0.29299999999999998,"5min":0.46000000000000002,"15min":0.499},"last":0.24299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:43:30.174 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:30.174 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:30.174 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:30.174 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:30.174 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:30.175 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:30.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-12-06T07:43:30.487 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-12-06T07:43:30.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-12-06T07:43:30.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:30.603+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:30.802 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-12-06T07:43:30.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-12-06T07:43:31.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:31.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:31.151 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-12-06T07:43:31.162 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-12-06T07:43:31.468 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-12-06T07:43:31.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-12-06T07:43:31.587 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:31.587+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:31.780 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-12-06T07:43:31.792 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-12-06T07:43:32.100 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:32.100+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:32.110 INFO:teuthology.orchestra.run.smithi134.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-12-06T07:43:32.120 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:43:32.609 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:32.608+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:33.106 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:33.105+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:33.592 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:33.592+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:34.135 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:34.135+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:34.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:34.577+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:35.094 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:35.094+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:35.582 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:35.582+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:36.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:36.046+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:36.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:36.536+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:37.011 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:37.011+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:37.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:37.513+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:38.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:38.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:38.532 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:38.532+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:39.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:39.058+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:39.538 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:39.537+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:40.102 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:40.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:40.578 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:40.578+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:41.081 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:41.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:41.628 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:41.628+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:42.062 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:42.062+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:42.601 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:42.601+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:43.103 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:43.102+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:43.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:43.645+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:44.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:44.086+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:44.665 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:44.663+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:45.058 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:45.057+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:45.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:45.659+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:46.093 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:46.091+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:46.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:46.674+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:47.052 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:47.051+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:47.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:47.697+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:48.005 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:48.004+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:48.673 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:48.672+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:49.014 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:49.013+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:49.710 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:49.708+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:50.023 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:50.022+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:50.686 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:50.685+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:51.066 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:51.064+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:51.651 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:51.650+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:52.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:52.073+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:52.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:43:52.418 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:43:52.420 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:43:52.432 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6234,"stamp":"2023-12-06T07:43:52.289232+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001852"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740804,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.224},"min":{"1min":0.14499999999999999,"5min":0.14499999999999999,"15min":0.13700000000000001},"max":{"1min":0.44500000000000001,"5min":0.46899999999999997,"15min":0.501},"last":0.184},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.26800000000000002,"15min":0.26900000000000002},"min":{"1min":0.20599999999999999,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.46300000000000002,"5min":0.498,"15min":0.50900000000000001},"last":0.27400000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:42:55 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.23200000000000001,"15min":0.23200000000000001},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.26300000000000001,"15min":0.26400000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.17100000000000001},"max":{"1min":0.45400000000000001,"5min":0.48699999999999999,"15min":0.48999999999999999},"last":0.252}]}]},{"osd":0,"up_from":8,"seq":34359740805,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.20499999999999999,"15min":0.20699999999999999},"min":{"1min":0.156,"5min":0.14599999999999999,"15min":0.13500000000000001},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.63400000000000001},"last":0.16400000000000001},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.27300000000000002,"15min":0.27100000000000002},"min":{"1min":0.20100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.45900000000000002,"5min":0.48099999999999998,"15min":0.64600000000000002},"last":0.23699999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.24099999999999999},"min":{"1min":0.17699999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.41499999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.247,"15min":0.24199999999999999},"min":{"1min":0.193,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.443,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.21299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740810,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.184,"5min":0.188,"15min":0.20200000000000001},"min":{"1min":0.13900000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.27900000000000003,"5min":0.32200000000000001,"15min":0.39700000000000002},"last":0.309},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.20399999999999999,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":0.28599999999999998,"5min":0.38700000000000001,"15min":0.48999999999999999},"last":0.35299999999999998}]},{"osd":2,"last update":"Wed Dec 6 07:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.22600000000000001,"15min":0.23300000000000001},"min":{"1min":0.182,"5min":0.16400000000000001,"15min":0.156},"max":{"1min":0.247,"5min":0.33700000000000002,"15min":0.47499999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26400000000000001,"15min":0.26500000000000001},"min":{"1min":0.223,"5min":0.184,"15min":0.17999999999999999},"max":{"1min":0.30299999999999999,"5min":0.36299999999999999,"15min":0.499},"last":0.373}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:43:52.433 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:52.434 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:52.434 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:52.434 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:52.434 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:52.434 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:43:52.434 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:43:52.672 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:52.671+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:53.080 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:53.079+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:53.658 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:53.656+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:54.041 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:54.040+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:54.697 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:54.696+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:55.000 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:54.999+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:55.686 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:55.685+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:56.046 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:56.044+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:56.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:56.724+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:57.086 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:57.085+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:57.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:57.724+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:58.074 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:58.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:58.757 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:58.756+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:59.026 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:43:59.025+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:43:59.794 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:43:59.793+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:00.070 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:00.069+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:00.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:00.764+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:01.028 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:01.027+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:01.816 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:01.815+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:02.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:02.047+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:02.864 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:02.863+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:03.068 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:03.062+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:03.844 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:03.843+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:04.072 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:04.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:04.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:04.879+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:05.082 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:05.081+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:05.931 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:05.929+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:06.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:06.087+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:06.978 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:06.977+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:07.126 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:07.125+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:08.024 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:08.023+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:08.149 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:08.148+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:09.046 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:09.045+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:09.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:09.183+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:10.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:10.057+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:10.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:10.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:11.088 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:11.087+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:11.231 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:11.230+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:12.057 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:12.056+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:12.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:12.215+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:12.436 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:44:12.747 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:44:12.749 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:44:12.761 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6244,"stamp":"2023-12-06T07:44:12.292301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001899"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740808,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.17000000000000001,"5min":0.14499999999999999,"15min":0.13700000000000001},"max":{"1min":0.41999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27100000000000002},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.48699999999999999,"5min":0.498,"15min":0.498},"last":0.25600000000000001}]},{"osd":1,"last update":"Wed Dec 6 07:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.184,"5min":0.155,"15min":0.155},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.22},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17100000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.249}]}]},{"osd":0,"up_from":8,"seq":34359740809,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.20499999999999999,"15min":0.20699999999999999},"min":{"1min":0.156,"5min":0.14599999999999999,"15min":0.13500000000000001},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.63400000000000001},"last":0.16600000000000001},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.27300000000000002,"15min":0.27100000000000002},"min":{"1min":0.20100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.45900000000000002,"5min":0.48099999999999998,"15min":0.64600000000000002},"last":0.245}]},{"osd":2,"last update":"Wed Dec 6 07:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.24099999999999999},"min":{"1min":0.17699999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.41499999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.216},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.247,"15min":0.24199999999999999},"min":{"1min":0.193,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.443,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.23200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740814,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.184,"5min":0.188,"15min":0.20200000000000001},"min":{"1min":0.13900000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.27900000000000003,"5min":0.32200000000000001,"15min":0.39700000000000002},"last":0.17199999999999999},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.20399999999999999,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":0.28599999999999998,"5min":0.38700000000000001,"15min":0.48999999999999999},"last":0.26900000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.22600000000000001,"15min":0.23300000000000001},"min":{"1min":0.182,"5min":0.16400000000000001,"15min":0.156},"max":{"1min":0.247,"5min":0.33700000000000002,"15min":0.47499999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26400000000000001,"15min":0.26500000000000001},"min":{"1min":0.223,"5min":0.184,"15min":0.17999999999999999},"max":{"1min":0.30299999999999999,"5min":0.36299999999999999,"15min":0.499},"last":0.29699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:44:12.762 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:12.762 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:12.762 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:12.762 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:12.763 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:12.763 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:12.763 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:44:13.105 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:13.104+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:13.259 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:13.258+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:14.066 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:14.065+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:14.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:14.284+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:15.025 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:15.024+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:15.264 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:15.264+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:15.994 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:15.993+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:16.253 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:16.252+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:17.028 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:17.028+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:17.284 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:17.283+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:18.052 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:18.052+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:18.237 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:18.237+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:19.058 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:19.058+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:19.268 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:19.268+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:20.106 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:20.106+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:20.261 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:20.261+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:21.117 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:21.117+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:21.296 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:21.296+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:22.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:22.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:22.336 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:22.336+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:23.128 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:23.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:23.297 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:23.297+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:24.162 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:24.162+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:24.254 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:24.254+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:25.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:25.178+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:25.300 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:25.300+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:26.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:26.193+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:26.308 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:26.307+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:27.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:27.239+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:27.283 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:27.282+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:28.248 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:28.247+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:28.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:28.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:29.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:29.229+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:29.282 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:29.281+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:30.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:30.255+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:30.292 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:30.291+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:31.273 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:31.272+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:31.282 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:31.281+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:32.252 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:32.251+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:32.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:32.292+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:32.765 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:44:33.067 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:44:33.069 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:44:33.083 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6254,"stamp":"2023-12-06T07:44:32.295527+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001877"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740812,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.17000000000000001,"5min":0.14499999999999999,"15min":0.13700000000000001},"max":{"1min":0.41999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.217},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27100000000000002},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.48699999999999999,"5min":0.498,"15min":0.498},"last":0.27500000000000002}]},{"osd":1,"last update":"Wed Dec 6 07:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.184,"5min":0.155,"15min":0.155},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17100000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.32100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740813,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.216,"5min":0.20499999999999999,"15min":0.20699999999999999},"min":{"1min":0.156,"5min":0.14599999999999999,"15min":0.13500000000000001},"max":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.63400000000000001},"last":0.223},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.27300000000000002,"15min":0.27100000000000002},"min":{"1min":0.20100000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.45900000000000002,"5min":0.48099999999999998,"15min":0.64600000000000002},"last":0.308}]},{"osd":2,"last update":"Wed Dec 6 07:43:32 2023","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.24099999999999999},"min":{"1min":0.17699999999999999,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.41499999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.247,"15min":0.24199999999999999},"min":{"1min":0.193,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.443,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.29099999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740818,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.184,"5min":0.188,"15min":0.20200000000000001},"min":{"1min":0.13900000000000001,"5min":0.13300000000000001,"15min":0.13},"max":{"1min":0.27900000000000003,"5min":0.32200000000000001,"15min":0.39700000000000002},"last":0.16800000000000001},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.20399999999999999,"5min":0.183,"15min":0.17199999999999999},"max":{"1min":0.28599999999999998,"5min":0.38700000000000001,"15min":0.48999999999999999},"last":0.27500000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:43:46 2023","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.22600000000000001,"15min":0.23300000000000001},"min":{"1min":0.182,"5min":0.16400000000000001,"15min":0.156},"max":{"1min":0.247,"5min":0.33700000000000002,"15min":0.47499999999999998},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.26400000000000001,"15min":0.26500000000000001},"min":{"1min":0.223,"5min":0.184,"15min":0.17999999999999999},"max":{"1min":0.30299999999999999,"5min":0.36299999999999999,"15min":0.499},"last":0.30299999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:44:33.085 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:33.085 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:33.085 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:33.085 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:33.085 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:33.086 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:33.086 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:44:33.226 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:33.225+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:33.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:33.309+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:34.220 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:34.219+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:34.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:34.263+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:35.189 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:35.188+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:35.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:35.247+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:36.150 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:36.149+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:36.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:36.223+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:37.140 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:37.139+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:37.210 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:37.209+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:38.182 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:38.181+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:38.239 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:38.238+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:39.188 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:39.187+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:39.227 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:39.226+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:40.185 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:40.184+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:40.187 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:40.187+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:41.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:41.147+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:41.187 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:41.186+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:42.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:42.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:42.228 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:42.227+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:43.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:43.142+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:43.208 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:43.206+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:44.138 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:44.137+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:44.179 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:44.178+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:45.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:45.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:45.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:45.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:46.123 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:46.121+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:46.124 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:46.124+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:47.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:47.146+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:47.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:47.163+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:48.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:48.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:48.164 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:48.163+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:49.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:49.143+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:49.193 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:49.192+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:50.096 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:50.095+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:50.190 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:50.189+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:51.114 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:51.113+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:51.151 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:51.150+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:52.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:52.111+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:52.158 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:52.157+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:53.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:44:53.103 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:53.102+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:53.124 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:53.123+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:44:53.389 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:44:53.401 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6264,"stamp":"2023-12-06T07:44:52.298354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001697"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740816,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23300000000000001,"15min":0.22600000000000001},"min":{"1min":0.17000000000000001,"5min":0.14499999999999999,"15min":0.13700000000000001},"max":{"1min":0.41999999999999998,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.27300000000000002,"15min":0.27100000000000002},"min":{"1min":0.214,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.48699999999999999,"5min":0.498,"15min":0.498},"last":0.223}]},{"osd":1,"last update":"Wed Dec 6 07:43:58 2023","interfaces":[{"interface":"back","average":{"1min":0.25700000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.184,"5min":0.155,"15min":0.155},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.18099999999999999},{"interface":"front","average":{"1min":0.29299999999999998,"5min":0.26900000000000002,"15min":0.26600000000000001},"min":{"1min":0.21099999999999999,"5min":0.18099999999999999,"15min":0.17100000000000001},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.20899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740817,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:44:32 2023","interfaces":[{"interface":"back","average":{"1min":0.20699999999999999,"5min":0.20599999999999999,"15min":0.20899999999999999},"min":{"1min":0.158,"5min":0.14599999999999999,"15min":0.13500000000000001},"max":{"1min":0.35599999999999998,"5min":0.40100000000000002,"15min":0.63400000000000001},"last":0.14199999999999999},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27300000000000002,"15min":0.27200000000000002},"min":{"1min":0.217,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.42099999999999999,"5min":0.48099999999999998,"15min":0.64600000000000002},"last":0.21099999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:44:32 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.245,"15min":0.24299999999999999},"min":{"1min":0.182,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.39100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.184},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.245,"15min":0.24199999999999999},"min":{"1min":0.19900000000000001,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.374,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.222}]}]},{"osd":1,"up_from":8,"seq":34359740822,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.19600000000000001,"5min":0.188,"15min":0.20000000000000001},"min":{"1min":0.13600000000000001,"5min":0.13600000000000001,"15min":0.13},"max":{"1min":0.309,"5min":0.32200000000000001,"15min":0.39500000000000002},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"min":{"1min":0.14499999999999999,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.375,"5min":0.38700000000000001,"15min":0.48999999999999999},"last":0.24299999999999999}]},{"osd":2,"last update":"Wed Dec 6 07:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.22700000000000001,"15min":0.23100000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.156},"max":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.42799999999999999},"last":0.214},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.26400000000000001},"min":{"1min":0.20100000000000001,"5min":0.184,"15min":0.17999999999999999},"max":{"1min":0.373,"5min":0.373,"15min":0.46500000000000002},"last":0.26400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:44:53.402 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:53.402 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:53.402 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:53.403 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:53.403 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:53.403 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:44:53.403 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-06T07:44:54.134 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:54.133+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:54.173 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:54.172+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:55.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:55.128+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:55.221 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:55.220+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:56.158 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:56.157+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:56.216 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:56.215+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:57.177 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:57.176+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:57.202 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:57.201+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:58.160 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:58.160+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:58.192 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:58.192+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:59.136 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:44:59.136+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:44:59.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:44:59.237+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:00.095 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:00.095+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:00.243 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:00.243+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:01.083 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:01.083+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:01.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:01.247+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:02.088 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:02.088+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:02.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:02.270+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:03.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:03.133+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:03.269 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:03.269+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:04.113 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:04.113+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:04.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:04.257+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:05.073 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:05.071+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:05.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:05.305+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:06.089 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:06.089+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:06.280 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:06.280+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:07.077 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:07.077+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:07.310 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:07.310+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:08.030 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:08.030+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:08.262 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:08.262+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:09.048 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:09.048+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:09.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:09.257+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:10.097 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:10.096+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:10.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:10.224+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:11.129 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:11.128+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:11.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:11.268+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:12.112 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:12.111+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:12.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:12.236+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:13.133 INFO:tasks.ceph.osd.0.smithi134.stderr:2023-12-06T07:45:13.132+0000 7f197ded6700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:316 3.3 3:f0be800e:test1::rbd_data.295227fc2d39.0000000000000082:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1843200~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=3 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:13.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2023-12-06T07:45:13.222+0000 7fc59c890700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10581.0:680 3.2 3:41741f50:test1::rbd_data.295227fc2d39.000000000000009d:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2883584~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected e155) 2023-12-06T07:45:13.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-06T07:45:13.755 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-12-06T07:45:13.757 INFO:teuthology.orchestra.run.smithi134.stderr:dumped all 2023-12-06T07:45:13.768 INFO:teuthology.orchestra.run.smithi134.stdout:{"pg_ready":true,"pg_map":{"version":6274,"stamp":"2023-12-06T07:45:12.301304+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":391241161,"num_objects":349,"num_object_clones":1,"num_object_copies":698,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":167,"num_read":65632,"num_read_kb":127780,"num_write":17733,"num_write_kb":8815996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":718,"num_omap_keys":64,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25258,"ondisk_log_size":25258,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1311252,"kb_used_data":386812,"kb_used_omap":0,"kb_used_meta":924416,"kb_avail":281804268,"statfs":{"total":289910292480,"available":288567570432,"internally_reserved":0,"allocated":396095488,"data_stored":393796968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":946601984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001793"},"pg_stats":[{"pgid":"2.7","version":"154'868","reported_seq":1776,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055135+0000","last_change":"2023-12-06T04:25:51.585058+0000","last_active":"2023-12-06T05:24:28.055135+0000","last_peered":"2023-12-06T05:24:28.055135+0000","last_clean":"2023-12-06T05:24:28.055135+0000","last_became_active":"2023-12-06T04:21:17.543745+0000","last_became_peered":"2023-12-06T04:21:17.543745+0000","last_unstale":"2023-12-06T05:24:28.055135+0000","last_undegraded":"2023-12-06T05:24:28.055135+0000","last_fullsized":"2023-12-06T05:24:28.055135+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":868,"ondisk_log_size":868,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":20971703,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":662,"num_read_kb":1820,"num_write":729,"num_write_kb":1183439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"155'1018","reported_seq":1994,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055081+0000","last_change":"2023-12-06T04:25:51.584341+0000","last_active":"2023-12-06T05:24:28.055081+0000","last_peered":"2023-12-06T05:24:28.055081+0000","last_clean":"2023-12-06T05:24:28.055081+0000","last_became_active":"2023-12-06T04:21:17.543444+0000","last_became_peered":"2023-12-06T04:21:17.543444+0000","last_unstale":"2023-12-06T05:24:28.055081+0000","last_undegraded":"2023-12-06T05:24:28.055081+0000","last_fullsized":"2023-12-06T05:24:28.055081+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":1018,"ondisk_log_size":1018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72282397,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":893,"num_read_kb":1380,"num_write":834,"num_write_kb":1181335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"155'766","reported_seq":1648,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.055024+0000","last_change":"2023-12-06T04:25:51.584923+0000","last_active":"2023-12-06T05:24:28.055024+0000","last_peered":"2023-12-06T05:24:28.055024+0000","last_clean":"2023-12-06T05:24:28.055024+0000","last_became_active":"2023-12-06T04:21:17.542775+0000","last_became_peered":"2023-12-06T04:21:17.542775+0000","last_unstale":"2023-12-06T05:24:28.055024+0000","last_undegraded":"2023-12-06T05:24:28.055024+0000","last_fullsized":"2023-12-06T05:24:28.055024+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24371455,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":585,"num_read_kb":3159,"num_write":643,"num_write_kb":1060128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"159'2684","reported_seq":6644,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:46.321495+0000","last_change":"2023-12-06T07:30:46.321495+0000","last_active":"2023-12-06T07:30:46.321495+0000","last_peered":"2023-12-06T07:30:46.321495+0000","last_clean":"2023-12-06T07:30:46.321495+0000","last_became_active":"2023-12-06T04:21:25.576654+0000","last_became_peered":"2023-12-06T04:21:25.576654+0000","last_unstale":"2023-12-06T07:30:46.321495+0000","last_undegraded":"2023-12-06T07:30:46.321495+0000","last_fullsized":"2023-12-06T07:30:46.321495+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'2684","last_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_deep_scrub":"159'2684","last_deep_scrub_stamp":"2023-12-06T07:30:46.321407+0000","last_clean_scrub_stamp":"2023-12-06T07:30:46.321407+0000","log_size":2684,"ondisk_log_size":2684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26997255,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":40,"num_read":8324,"num_read_kb":14949,"num_write":1433,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":519,"num_flush":172,"num_flush_kb":6964,"num_evict":444,"num_evict_kb":29266,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"159'1403","reported_seq":2474,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:24.178079+0000","last_change":"2023-12-06T07:28:24.178079+0000","last_active":"2023-12-06T07:28:24.178079+0000","last_peered":"2023-12-06T07:28:24.178079+0000","last_clean":"2023-12-06T07:28:24.178079+0000","last_became_active":"2023-12-06T04:21:17.543637+0000","last_became_peered":"2023-12-06T04:21:17.543637+0000","last_unstale":"2023-12-06T07:28:24.178079+0000","last_undegraded":"2023-12-06T07:28:24.178079+0000","last_fullsized":"2023-12-06T07:28:24.178079+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1403","last_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_deep_scrub":"159'1403","last_deep_scrub_stamp":"2023-12-06T07:28:24.177998+0000","last_clean_scrub_stamp":"2023-12-06T07:28:24.177998+0000","log_size":1403,"ondisk_log_size":1403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":53841986,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":1039,"num_read_kb":5120,"num_write":812,"num_write_kb":1076056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":449,"num_omap_keys":36,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"155'3966","reported_seq":10860,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054840+0000","last_change":"2023-12-06T04:25:51.588096+0000","last_active":"2023-12-06T05:24:28.054840+0000","last_peered":"2023-12-06T05:24:28.054840+0000","last_clean":"2023-12-06T05:24:28.054840+0000","last_became_active":"2023-12-06T04:21:25.576675+0000","last_became_peered":"2023-12-06T04:21:25.576675+0000","last_unstale":"2023-12-06T05:24:28.054840+0000","last_undegraded":"2023-12-06T05:24:28.054840+0000","last_fullsized":"2023-12-06T05:24:28.054840+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":3966,"ondisk_log_size":3966,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31363918,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":40,"num_read":13264,"num_read_kb":19442,"num_write":2021,"num_write_kb":859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":811,"num_flush":187,"num_flush_kb":30,"num_evict":514,"num_evict_kb":21213,"num_promote":565,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":159,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:47.004894+0000","last_change":"2023-12-06T07:30:47.004894+0000","last_active":"2023-12-06T07:30:47.004894+0000","last_peered":"2023-12-06T07:30:47.004894+0000","last_clean":"2023-12-06T07:30:47.004894+0000","last_became_active":"2023-12-06T04:21:17.544605+0000","last_became_peered":"2023-12-06T04:21:17.544605+0000","last_unstale":"2023-12-06T07:30:47.004894+0000","last_undegraded":"2023-12-06T07:30:47.004894+0000","last_fullsized":"2023-12-06T07:30:47.004894+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T07:30:47.004768+0000","last_clean_scrub_stamp":"2023-12-06T07:30:47.004768+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"159'1291","reported_seq":2221,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:59.079524+0000","last_change":"2023-12-06T07:30:59.079524+0000","last_active":"2023-12-06T07:30:59.079524+0000","last_peered":"2023-12-06T07:30:59.079524+0000","last_clean":"2023-12-06T07:30:59.079524+0000","last_became_active":"2023-12-06T04:21:17.542669+0000","last_became_peered":"2023-12-06T04:21:17.542669+0000","last_unstale":"2023-12-06T07:30:59.079524+0000","last_undegraded":"2023-12-06T07:30:59.079524+0000","last_fullsized":"2023-12-06T07:30:59.079524+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'1291","last_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_deep_scrub":"159'1291","last_deep_scrub_stamp":"2023-12-06T07:30:59.079433+0000","last_clean_scrub_stamp":"2023-12-06T07:30:59.079433+0000","log_size":1291,"ondisk_log_size":1291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":18586749,"num_objects":15,"num_object_clones":1,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":636,"num_read_kb":4010,"num_write":699,"num_write_kb":1069861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":101,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"155'5121","reported_seq":12116,"reported_epoch":158,"state":"active+clean","last_fresh":"2023-12-06T05:24:28.054726+0000","last_change":"2023-12-06T04:25:51.587997+0000","last_active":"2023-12-06T05:24:28.054726+0000","last_peered":"2023-12-06T05:24:28.054726+0000","last_clean":"2023-12-06T05:24:28.054726+0000","last_became_active":"2023-12-06T04:21:25.574925+0000","last_became_peered":"2023-12-06T04:21:25.574925+0000","last_unstale":"2023-12-06T05:24:28.054726+0000","last_undegraded":"2023-12-06T05:24:28.054726+0000","last_fullsized":"2023-12-06T05:24:28.054726+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:24.560891+0000","last_clean_scrub_stamp":"2023-12-06T04:21:24.560891+0000","log_size":5121,"ondisk_log_size":5121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22160639,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":42,"num_read":14413,"num_read_kb":35852,"num_write":2928,"num_write_kb":1362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1271,"num_flush":220,"num_flush_kb":8816,"num_evict":509,"num_evict_kb":42672,"num_promote":560,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"159'825","reported_seq":1681,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:28:32.347746+0000","last_change":"2023-12-06T07:28:32.347746+0000","last_active":"2023-12-06T07:28:32.347746+0000","last_peered":"2023-12-06T07:28:32.347746+0000","last_clean":"2023-12-06T07:28:32.347746+0000","last_became_active":"2023-12-06T04:21:17.542950+0000","last_became_peered":"2023-12-06T04:21:17.542950+0000","last_unstale":"2023-12-06T07:28:32.347746+0000","last_undegraded":"2023-12-06T07:28:32.347746+0000","last_fullsized":"2023-12-06T07:28:32.347746+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'825","last_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_deep_scrub":"159'825","last_deep_scrub_stamp":"2023-12-06T07:28:32.347626+0000","last_clean_scrub_stamp":"2023-12-06T07:28:32.347626+0000","log_size":825,"ondisk_log_size":825,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38027349,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":574,"num_read_kb":1989,"num_write":682,"num_write_kb":1031287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"159'5528","reported_seq":13252,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:52.185885+0000","last_change":"2023-12-06T07:30:52.185885+0000","last_active":"2023-12-06T07:30:52.185885+0000","last_peered":"2023-12-06T07:30:52.185885+0000","last_clean":"2023-12-06T07:30:52.185885+0000","last_became_active":"2023-12-06T04:21:25.576609+0000","last_became_peered":"2023-12-06T04:21:25.576609+0000","last_unstale":"2023-12-06T07:30:52.185885+0000","last_undegraded":"2023-12-06T07:30:52.185885+0000","last_fullsized":"2023-12-06T07:30:52.185885+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'5528","last_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_deep_scrub":"159'5528","last_deep_scrub_stamp":"2023-12-06T07:30:52.185796+0000","last_clean_scrub_stamp":"2023-12-06T07:30:52.185796+0000","log_size":5528,"ondisk_log_size":5528,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":763,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":44,"num_read":23137,"num_read_kb":36709,"num_write":5465,"num_write_kb":4126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":665,"num_flush":209,"num_flush_kb":26,"num_evict":445,"num_evict_kb":34592,"num_promote":491,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"159'862","reported_seq":2040,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-12-06T07:30:50.188245+0000","last_change":"2023-12-06T07:30:50.188245+0000","last_active":"2023-12-06T07:30:50.188245+0000","last_peered":"2023-12-06T07:30:50.188245+0000","last_clean":"2023-12-06T07:30:50.188245+0000","last_became_active":"2023-12-06T04:21:17.545022+0000","last_became_peered":"2023-12-06T04:21:17.545022+0000","last_unstale":"2023-12-06T07:30:50.188245+0000","last_undegraded":"2023-12-06T07:30:50.188245+0000","last_fullsized":"2023-12-06T07:30:50.188245+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'862","last_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_deep_scrub":"159'862","last_deep_scrub_stamp":"2023-12-06T07:30:50.188167+0000","last_clean_scrub_stamp":"2023-12-06T07:30:50.188167+0000","log_size":862,"ondisk_log_size":862,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28426329,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1150,"num_read_kb":767,"num_write":693,"num_write_kb":1062968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":94,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"155'926","reported_seq":1952,"reported_epoch":159,"state":"active+clean+scrubbing+deep","last_fresh":"2023-12-06T07:31:04.129985+0000","last_change":"2023-12-06T07:31:04.129985+0000","last_active":"2023-12-06T07:31:04.129985+0000","last_peered":"2023-12-06T07:31:04.129985+0000","last_clean":"2023-12-06T07:31:04.129985+0000","last_became_active":"2023-12-06T04:21:17.544540+0000","last_became_peered":"2023-12-06T04:21:17.544540+0000","last_unstale":"2023-12-06T07:31:04.129985+0000","last_undegraded":"2023-12-06T07:31:04.129985+0000","last_fullsized":"2023-12-06T07:31:04.129985+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-06T04:21:16.527312+0000","last_clean_scrub_stamp":"2023-12-06T04:21:16.527312+0000","log_size":926,"ondisk_log_size":926,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54210618,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":955,"num_read_kb":2583,"num_write":794,"num_write_kb":1143933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":80522575,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":109,"num_whiteouts":166,"num_read":59138,"num_read_kb":106952,"num_write":11847,"num_write_kb":6989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":14,"num_bytes_hit_set_archive":3266,"num_flush":788,"num_flush_kb":15836,"num_evict":1912,"num_evict_kb":127743,"num_promote":2107,"num_flush_mode_high":0,"num_flush_mode_low":3,"num_evict_mode_some":2,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95150080,"data_stored":95009438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17299,"ondisk_log_size":17299,"up":8,"acting":8,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":310718586,"num_objects":139,"num_object_clones":1,"num_object_copies":278,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":139,"num_whiteouts":1,"num_read":6494,"num_read_kb":20828,"num_write":5886,"num_write_kb":8809007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":644,"num_omap_keys":56,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":296935424,"data_stored":296689908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7959,"ondisk_log_size":7959,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740820,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":411220,"kb_used_data":101708,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93960620,"statfs":{"total":96636764160,"available":96215674880,"internally_reserved":0,"allocated":104148992,"data_stored":103400501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:44:59 2023","interfaces":[{"interface":"back","average":{"1min":0.22600000000000001,"5min":0.23100000000000001,"15min":0.22700000000000001},"min":{"1min":0.17899999999999999,"5min":0.14499999999999999,"15min":0.13700000000000001},"max":{"1min":0.39700000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.20300000000000001},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.26800000000000002,"15min":0.27000000000000002},"min":{"1min":0.20799999999999999,"5min":0.19700000000000001,"15min":0.188},"max":{"1min":0.40500000000000003,"5min":0.48699999999999999,"15min":0.498},"last":0.22}]},{"osd":1,"last update":"Wed Dec 6 07:44:59 2023","interfaces":[{"interface":"back","average":{"1min":0.22700000000000001,"5min":0.23599999999999999,"15min":0.23400000000000001},"min":{"1min":0.18099999999999999,"5min":0.155,"15min":0.155},"max":{"1min":0.35399999999999998,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.253,"5min":0.26700000000000002,"15min":0.26500000000000001},"min":{"1min":0.20899999999999999,"5min":0.18099999999999999,"15min":0.17100000000000001},"max":{"1min":0.38600000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.21099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740821,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":415372,"kb_used_data":105860,"kb_used_omap":0,"kb_used_meta":309504,"kb_avail":93956468,"statfs":{"total":96636764160,"available":96211423232,"internally_reserved":0,"allocated":108400640,"data_stored":107659834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316932096},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 6 07:44:32 2023","interfaces":[{"interface":"back","average":{"1min":0.20699999999999999,"5min":0.20599999999999999,"15min":0.20899999999999999},"min":{"1min":0.158,"5min":0.14599999999999999,"15min":0.13500000000000001},"max":{"1min":0.35599999999999998,"5min":0.40100000000000002,"15min":0.63400000000000001},"last":0.247},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.27300000000000002,"15min":0.27200000000000002},"min":{"1min":0.217,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.42099999999999999,"5min":0.48099999999999998,"15min":0.64600000000000002},"last":0.255}]},{"osd":2,"last update":"Wed Dec 6 07:44:32 2023","interfaces":[{"interface":"back","average":{"1min":0.251,"5min":0.245,"15min":0.24299999999999999},"min":{"1min":0.182,"5min":0.17199999999999999,"15min":0.159},"max":{"1min":0.39100000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"last":0.223},{"interface":"front","average":{"1min":0.23899999999999999,"5min":0.245,"15min":0.24199999999999999},"min":{"1min":0.19900000000000001,"5min":0.16300000000000001,"15min":0.156},"max":{"1min":0.374,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.26800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740826,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":484660,"kb_used_data":179244,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93887180,"statfs":{"total":96636764160,"available":96140472320,"internally_reserved":0,"allocated":183545856,"data_stored":182736633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 6 07:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.19600000000000001,"5min":0.188,"15min":0.20000000000000001},"min":{"1min":0.13600000000000001,"5min":0.13600000000000001,"15min":0.13},"max":{"1min":0.309,"5min":0.32200000000000001,"15min":0.39500000000000002},"last":0.17100000000000001},{"interface":"front","average":{"1min":0.27000000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"min":{"1min":0.14499999999999999,"5min":0.14499999999999999,"15min":0.14499999999999999},"max":{"1min":0.375,"5min":0.38700000000000001,"15min":0.48999999999999999},"last":0.27400000000000002}]},{"osd":2,"last update":"Wed Dec 6 07:44:48 2023","interfaces":[{"interface":"back","average":{"1min":0.24399999999999999,"5min":0.22700000000000001,"15min":0.23100000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.156},"max":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.42799999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.26500000000000001,"15min":0.26400000000000001},"min":{"1min":0.20100000000000001,"5min":0.184,"15min":0.17999999999999999},"max":{"1min":0.373,"5min":0.373,"15min":0.46500000000000002},"last":0.245}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":93229056,"data_stored":93148006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":148467712,"data_stored":148344954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":55238656,"data_stored":55196948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13836288,"data_stored":13812994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":33738752,"data_stored":33691725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":47575040,"data_stored":47504719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-06T07:45:13.770 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:45:13.770 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:45:13.770 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:45:13.770 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:45:13.771 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-12-06T04:21:24.560891+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=24, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:45:13.771 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-12-06T04:21:16.527312+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=4, tm_min=21, tm_sec=16, tm_wday=2, tm_yday=340, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=6, tm_hour=7, tm_min=24, tm_sec=19, tm_wday=2, tm_yday=340, tm_isdst=0) 2023-12-06T07:45:13.771 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-12-06T07:45:13.811 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-06T07:45:13.811 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-06T07:45:13.811 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-06T07:45:13.811 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T07:45:13.841 INFO:tasks.ceph.osd.0:Stopped 2023-12-06T07:45:13.841 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-06T07:45:13.841 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T07:45:13.916 INFO:tasks.ceph.osd.1:Stopped 2023-12-06T07:45:13.916 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-06T07:45:13.916 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T07:45:13.988 INFO:tasks.ceph.osd.2:Stopped 2023-12-06T07:45:13.989 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-06T07:45:13.989 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-06T07:45:13.989 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T07:45:14.050 INFO:tasks.ceph.mgr.x:Stopped 2023-12-06T07:45:14.051 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-06T07:45:14.051 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-06T07:45:14.051 INFO:teuthology.orchestra.run:waiting for 300 2023-12-06T07:45:14.125 INFO:tasks.ceph.mon.a:Stopped 2023-12-06T07:45:14.125 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-06T07:45:14.126 DEBUG:teuthology.orchestra.run.smithi134:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | head -n 1 2023-12-06T07:45:14.194 INFO:teuthology.orchestra.run.smithi134.stdout:2023-12-06T04:26:38.061532+0000 osd.1 (osd.1) 3 : cluster [WRN] 5 slow requests (by type [ 'reached pg' : 5 ] most affected pool [ 'cache' : 5 ]) 2023-12-06T07:45:14.195 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-06T07:45:14.196 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T07:45:14.196 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-06T07:45:14.594 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T07:45:14.594 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-06T07:45:14.696 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T07:45:14.697 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-06T07:45:14.767 INFO:tasks.ceph:Archiving mon data... 2023-12-06T07:45:14.769 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760/data/mon.a.tgz 2023-12-06T07:45:14.769 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2023-12-06T07:45:14.786 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.0CUbRabkl6 2023-12-06T07:45:14.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0CUbRabkl6 2023-12-06T07:45:15.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.0CUbRabkl6 2023-12-06T07:45:15.155 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.0CUbRabkl6 is 642KB 2023-12-06T07:45:15.255 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.0CUbRabkl6 2023-12-06T07:45:15.274 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-06T07:45:15.274 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-06T07:45:15.339 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-06T07:45:15.339 DEBUG:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-06T07:45:15.406 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-06T07:45:15.412 INFO:tasks.ceph:Archiving crash dumps... 2023-12-06T07:45:15.414 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760/remote/smithi134/crash 2023-12-06T07:45:15.416 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-06T07:45:15.478 INFO:tasks.ceph:Compressing logs... 2023-12-06T07:45:15.479 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-06T07:45:16.047 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132275.log 2023-12-06T07:45:16.047 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150300.log 2023-12-06T07:45:16.047 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124364.log 2023-12-06T07:45:16.047 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132275.log.gz 2023-12-06T07:45:16.047 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142538.log 2023-12-06T07:45:16.048 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150300.log.gz 2023-12-06T07:45:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138846.log 2023-12-06T07:45:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124364.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124364.log.gz 2023-12-06T07:45:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138018.log 2023-12-06T07:45:16.048 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142538.log.gz 2023-12-06T07:45:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117511.log 2023-12-06T07:45:16.048 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.138846.log.gz 2023-12-06T07:45:16.048 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122914.log 2023-12-06T07:45:16.048 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138018.log.gz 2023-12-06T07:45:16.049 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124077.log 2023-12-06T07:45:16.049 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117511.log.gz 2023-12-06T07:45:16.049 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141872.log 2023-12-06T07:45:16.049 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122914.log.gz 2023-12-06T07:45:16.049 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124077.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.124077.log.gz-- 2023-12-06T07:45:16.049 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122506.log 2023-12-06T07:45:16.049 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120983.log 2023-12-06T07:45:16.049 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141872.log.gz 2023-12-06T07:45:16.049 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122463.log 2023-12-06T07:45:16.050 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122506.log.gz 2023-12-06T07:45:16.050 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154954.log 2023-12-06T07:45:16.050 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120983.log.gz 2023-12-06T07:45:16.050 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124142.log 2023-12-06T07:45:16.050 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122463.log.gz 2023-12-06T07:45:16.050 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142452.log 2023-12-06T07:45:16.050 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154954.log.gz 2023-12-06T07:45:16.050 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150816.log 2023-12-06T07:45:16.050 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124142.log.gz 2023-12-06T07:45:16.051 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133095.log 2023-12-06T07:45:16.051 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142452.log.gz 2023-12-06T07:45:16.051 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121004.log 2023-12-06T07:45:16.051 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150816.log.gz 2023-12-06T07:45:16.051 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124056.log 2023-12-06T07:45:16.051 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133095.log.gz 2023-12-06T07:45:16.051 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123252.log 2023-12-06T07:45:16.051 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121004.log.gz 2023-12-06T07:45:16.051 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162332.log 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124056.log.gz 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131825.log 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123252.log.gz 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149699.log 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162332.log.gz 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147206.log 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr: 23.0% -- replaced with /var/log/ceph/ceph-client.admin.131825.log.gz 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152890.log 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149699.log.gz 2023-12-06T07:45:16.052 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122097.log 2023-12-06T07:45:16.053 INFO:teuthology.orchestra.run.smithi134.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.147206.log.gz 2023-12-06T07:45:16.053 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161195.log 2023-12-06T07:45:16.053 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152890.log.gz 2023-12-06T07:45:16.053 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128193.log 2023-12-06T07:45:16.053 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122097.log.gz 2023-12-06T07:45:16.053 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150000.log 2023-12-06T07:45:16.053 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161195.log.gz 2023-12-06T07:45:16.053 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136896.log 2023-12-06T07:45:16.053 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128193.log.gz 2023-12-06T07:45:16.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136015.log 2023-12-06T07:45:16.054 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150000.log.gz 2023-12-06T07:45:16.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160313.log 2023-12-06T07:45:16.054 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.136896.log.gz 2023-12-06T07:45:16.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123022.log 2023-12-06T07:45:16.054 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.136015.log.gz 2023-12-06T07:45:16.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123540.log 2023-12-06T07:45:16.054 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160313.log.gz 2023-12-06T07:45:16.054 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147550.log 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123022.log.gz 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125588.log 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123540.log.gz 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149082.log 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147550.log.gz 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152503.log 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125588.log.gz 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143328.log 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149082.log.gz 2023-12-06T07:45:16.055 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143736.log 2023-12-06T07:45:16.056 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152503.log.gz 2023-12-06T07:45:16.056 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132992.log 2023-12-06T07:45:16.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143328.log.gz 2023-12-06T07:45:16.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138104.log 2023-12-06T07:45:16.056 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.143736.log.gz 2023-12-06T07:45:16.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156825.log 2023-12-06T07:45:16.056 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132992.log.gz 2023-12-06T07:45:16.056 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141184.log 2023-12-06T07:45:16.056 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138104.log.gz 2023-12-06T07:45:16.057 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148003.log 2023-12-06T07:45:16.057 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156825.log.gz 2023-12-06T07:45:16.057 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141763.log 2023-12-06T07:45:16.057 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141184.log.gz 2023-12-06T07:45:16.057 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123425.log 2023-12-06T07:45:16.057 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148003.log.gz 2023-12-06T07:45:16.057 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130921.log 2023-12-06T07:45:16.057 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141763.log.gz 2023-12-06T07:45:16.057 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155703.log 2023-12-06T07:45:16.058 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.123425.log.gz 2023-12-06T07:45:16.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127776.log 2023-12-06T07:45:16.058 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130921.log.gz 2023-12-06T07:45:16.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126976.log 2023-12-06T07:45:16.058 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155703.log.gz 2023-12-06T07:45:16.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141355.log 2023-12-06T07:45:16.058 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127776.log.gz 2023-12-06T07:45:16.058 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127436.log 2023-12-06T07:45:16.058 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126976.log.gz 2023-12-06T07:45:16.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133417.log 2023-12-06T07:45:16.059 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141355.log.gz 2023-12-06T07:45:16.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127176.log 2023-12-06T07:45:16.059 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127436.log.gz 2023-12-06T07:45:16.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124602.log 2023-12-06T07:45:16.059 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133417.log.gz 2023-12-06T07:45:16.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156453.log 2023-12-06T07:45:16.059 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127176.log.gz 2023-12-06T07:45:16.059 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142963.log 2023-12-06T07:45:16.060 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124602.log.gz 2023-12-06T07:45:16.060 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140541.log 2023-12-06T07:45:16.060 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156453.log.gz 2023-12-06T07:45:16.060 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157240.log 2023-12-06T07:45:16.060 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142963.log.gz 2023-12-06T07:45:16.060 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159711.log 2023-12-06T07:45:16.060 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140541.log.gz 2023-12-06T07:45:16.060 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127676.log 2023-12-06T07:45:16.060 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157240.log.gz 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128465.log 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159711.log.gz 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159389.log 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127676.log.gz 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160750.log 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128465.log.gz 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161963.log 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159389.log.gz 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169893.log 2023-12-06T07:45:16.061 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160750.log.gz 2023-12-06T07:45:16.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140245.log 2023-12-06T07:45:16.062 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161963.log.gz 2023-12-06T07:45:16.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125724.log 2023-12-06T07:45:16.062 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169893.log.gz 2023-12-06T07:45:16.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122033.log 2023-12-06T07:45:16.062 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140245.log.gz 2023-12-06T07:45:16.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121133.log 2023-12-06T07:45:16.062 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125724.log.gz 2023-12-06T07:45:16.062 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160034.log 2023-12-06T07:45:16.063 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122033.log.gz 2023-12-06T07:45:16.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132125.log 2023-12-06T07:45:16.063 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121133.log.gz 2023-12-06T07:45:16.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131173.log 2023-12-06T07:45:16.063 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160034.log.gz 2023-12-06T07:45:16.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133033.log 2023-12-06T07:45:16.063 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132125.log.gz 2023-12-06T07:45:16.063 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149921.log 2023-12-06T07:45:16.063 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131173.log.gz 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137691.log 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133033.log.gz 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134618.log 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149921.log.gz 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153191.log 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137691.log.gz 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148932.log 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134618.log.gz 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161156.log 2023-12-06T07:45:16.064 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153191.log.gz 2023-12-06T07:45:16.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136433.log 2023-12-06T07:45:16.065 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148932.log.gz 2023-12-06T07:45:16.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143199.log 2023-12-06T07:45:16.065 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161156.log.gz 2023-12-06T07:45:16.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155054.log 2023-12-06T07:45:16.065 INFO:teuthology.orchestra.run.smithi134.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.136433.log.gz 2023-12-06T07:45:16.065 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143199.log.gz 2023-12-06T07:45:16.065 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120049.log 2023-12-06T07:45:16.065 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133288.log 2023-12-06T07:45:16.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155054.log.gz 2023-12-06T07:45:16.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162955.log 2023-12-06T07:45:16.066 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.120049.log.gz 2023-12-06T07:45:16.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120383.log 2023-12-06T07:45:16.066 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133288.log.gz 2023-12-06T07:45:16.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126676.log 2023-12-06T07:45:16.066 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162955.log.gz 2023-12-06T07:45:16.066 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158753.log 2023-12-06T07:45:16.066 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120383.log.gz 2023-12-06T07:45:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118884.log 2023-12-06T07:45:16.067 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126676.log.gz 2023-12-06T07:45:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153363.log 2023-12-06T07:45:16.067 INFO:teuthology.orchestra.run.smithi134.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.158753.log.gz 2023-12-06T07:45:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151746.log 2023-12-06T07:45:16.067 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118884.log.gz 2023-12-06T07:45:16.067 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142431.log 2023-12-06T07:45:16.067 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153363.log.gz 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142409.log 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151746.log.gz 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142431.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.142431.log.gz-5 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.159991.log 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128295.log 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142409.log.gz 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146432.log 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159991.log.gz 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129621.log 2023-12-06T07:45:16.068 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128295.log.gz 2023-12-06T07:45:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129723.log 2023-12-06T07:45:16.069 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146432.log.gz 2023-12-06T07:45:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129621.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.151313.log 2023-12-06T07:45:16.069 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129621.log.gz 2023-12-06T07:45:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133503.log 2023-12-06T07:45:16.069 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129723.log.gz 2023-12-06T07:45:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118346.log 2023-12-06T07:45:16.069 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151313.log.gz 2023-12-06T07:45:16.069 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133503.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.133503.log.gz-- 2023-12-06T07:45:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123733.log 2023-12-06T07:45:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118346.log.gz 2023-12-06T07:45:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142661.log 2023-12-06T07:45:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123733.log.gz 2023-12-06T07:45:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120682.log 2023-12-06T07:45:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158242.log 2023-12-06T07:45:16.070 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142661.log.gz 2023-12-06T07:45:16.070 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138490.log 2023-12-06T07:45:16.070 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120682.log.gz 2023-12-06T07:45:16.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149448.log 2023-12-06T07:45:16.071 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158242.log.gz 2023-12-06T07:45:16.071 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134298.log 2023-12-06T07:45:16.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138490.log.gz 2023-12-06T07:45:16.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146306.log 2023-12-06T07:45:16.071 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149448.log.gz 2023-12-06T07:45:16.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136032.log 2023-12-06T07:45:16.071 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.134298.log.gz 2023-12-06T07:45:16.071 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127716.log 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146306.log.gz 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142001.log 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136032.log.gz 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132931.log 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127716.log.gz 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146863.log 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142001.log.gz 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132641.log 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132931.log.gz 2023-12-06T07:45:16.072 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124721.log 2023-12-06T07:45:16.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146863.log: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.146863.log.gz 2023-12-06T07:45:16.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130270.log 2023-12-06T07:45:16.073 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132641.log.gz 2023-12-06T07:45:16.073 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154404.log 2023-12-06T07:45:16.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124721.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124721.log.gz 2023-12-06T07:45:16.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140562.log 2023-12-06T07:45:16.073 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130270.log.gz 2023-12-06T07:45:16.073 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154404.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.154404.log.gz--verbose 2023-12-06T07:45:16.073 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.153577.log 2023-12-06T07:45:16.074 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123269.log 2023-12-06T07:45:16.074 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140562.log.gz 2023-12-06T07:45:16.074 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137606.log 2023-12-06T07:45:16.074 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153577.log.gz 2023-12-06T07:45:16.074 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140585.log 0.0% 2023-12-06T07:45:16.074 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123269.log.gz 2023-12-06T07:45:16.074 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155526.log 2023-12-06T07:45:16.074 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137606.log.gz 2023-12-06T07:45:16.074 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140585.log.gzgzip 2023-12-06T07:45:16.075 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.138946.log 2023-12-06T07:45:16.075 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125792.log 2023-12-06T07:45:16.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155526.log.gz 2023-12-06T07:45:16.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146371.log 2023-12-06T07:45:16.075 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138946.log.gz 2023-12-06T07:45:16.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149018.log 2023-12-06T07:45:16.075 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125792.log.gz 2023-12-06T07:45:16.075 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150666.log 2023-12-06T07:45:16.075 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146371.log.gz 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123583.log 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149018.log.gz 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135875.log 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150666.log.gz 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131783.log 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123583.log.gz 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168946.log 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.135875.log.gz 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157019.log 2023-12-06T07:45:16.076 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131783.log.gz 2023-12-06T07:45:16.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129043.log 2023-12-06T07:45:16.077 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168946.log.gz 2023-12-06T07:45:16.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140062.log 2023-12-06T07:45:16.077 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157019.log.gz 2023-12-06T07:45:16.077 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119335.log 2023-12-06T07:45:16.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129043.log.gz 2023-12-06T07:45:16.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129570.log 2023-12-06T07:45:16.077 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140062.log.gz 2023-12-06T07:45:16.077 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156628.log 2023-12-06T07:45:16.078 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119335.log.gz 2023-12-06T07:45:16.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139187.log 2023-12-06T07:45:16.078 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129570.log.gz 2023-12-06T07:45:16.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137391.log 2023-12-06T07:45:16.078 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156628.log.gz 2023-12-06T07:45:16.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155643.log 2023-12-06T07:45:16.078 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139187.log.gz 2023-12-06T07:45:16.078 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128771.log 2023-12-06T07:45:16.078 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137391.log.gz 2023-12-06T07:45:16.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130774.log 2023-12-06T07:45:16.079 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155643.log.gz 2023-12-06T07:45:16.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154542.log 2023-12-06T07:45:16.079 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128771.log.gz 2023-12-06T07:45:16.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128669.log 2023-12-06T07:45:16.079 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130774.log.gz 2023-12-06T07:45:16.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152825.log 2023-12-06T07:45:16.079 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154542.log.gz 2023-12-06T07:45:16.079 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154578.log 2023-12-06T07:45:16.080 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128669.log.gz 2023-12-06T07:45:16.080 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133310.log 2023-12-06T07:45:16.080 INFO:teuthology.orchestra.run.smithi134.stderr: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.152825.log.gz 2023-12-06T07:45:16.080 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124993.log 2023-12-06T07:45:16.080 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154578.log.gz 2023-12-06T07:45:16.080 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139445.log 2023-12-06T07:45:16.080 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133310.log.gz 2023-12-06T07:45:16.080 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130144.log 2023-12-06T07:45:16.080 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124993.log.gz 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151563.log 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139445.log.gz 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119879.log 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130144.log.gz 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151563.log.gz 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135777.log 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157259.log 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119879.log.gz 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152438.log 2023-12-06T07:45:16.081 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135777.log.gz 2023-12-06T07:45:16.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143285.log 2023-12-06T07:45:16.082 INFO:teuthology.orchestra.run.smithi134.stderr: 51.5% -- replaced with /var/log/ceph/ceph-client.admin.157259.log.gz 2023-12-06T07:45:16.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132951.log 2023-12-06T07:45:16.082 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152438.log.gz 2023-12-06T07:45:16.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148996.log 2023-12-06T07:45:16.082 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143285.log.gz 2023-12-06T07:45:16.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129689.log 2023-12-06T07:45:16.082 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132951.log.gz 2023-12-06T07:45:16.082 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151912.log 2023-12-06T07:45:16.083 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148996.log.gz 2023-12-06T07:45:16.083 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154050.log 2023-12-06T07:45:16.083 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129689.log.gz 2023-12-06T07:45:16.083 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125044.log 2023-12-06T07:45:16.083 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151912.log.gz 2023-12-06T07:45:16.083 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149491.log 2023-12-06T07:45:16.083 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154050.log.gz 2023-12-06T07:45:16.083 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159668.log 2023-12-06T07:45:16.083 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125044.log.gz 2023-12-06T07:45:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127256.log 2023-12-06T07:45:16.084 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149491.log.gz 2023-12-06T07:45:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148534.log 2023-12-06T07:45:16.084 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159668.log.gz 2023-12-06T07:45:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141162.log 2023-12-06T07:45:16.084 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127256.log.gz 2023-12-06T07:45:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158509.log 2023-12-06T07:45:16.084 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148534.log.gz 2023-12-06T07:45:16.084 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125384.log 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141162.log.gz 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141656.log 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158509.log.gz 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114358.log 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125384.log.gz 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140771.log 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141656.log.gz 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.114358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147831.log 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114358.log.gz 2023-12-06T07:45:16.085 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134560.log 2023-12-06T07:45:16.086 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140771.log.gz 2023-12-06T07:45:16.086 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147831.log.gz 2023-12-06T07:45:16.086 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140520.log 2023-12-06T07:45:16.086 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125690.log 2023-12-06T07:45:16.086 INFO:teuthology.orchestra.run.smithi134.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.134560.log.gz 2023-12-06T07:45:16.086 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119142.log 2023-12-06T07:45:16.086 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140520.log.gz 2023-12-06T07:45:16.086 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128958.log 2023-12-06T07:45:16.087 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125690.log.gz 2023-12-06T07:45:16.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121883.log 2023-12-06T07:45:16.087 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119142.log.gz 2023-12-06T07:45:16.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156236.log 2023-12-06T07:45:16.087 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128958.log.gz 2023-12-06T07:45:16.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139859.log 2023-12-06T07:45:16.087 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121883.log.gz 2023-12-06T07:45:16.087 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130207.log 2023-12-06T07:45:16.087 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156236.log.gz 2023-12-06T07:45:16.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124330.log 2023-12-06T07:45:16.088 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.139859.log.gz 2023-12-06T07:45:16.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155785.log 2023-12-06T07:45:16.088 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.130207.log.gz 2023-12-06T07:45:16.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135508.log 2023-12-06T07:45:16.088 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124330.log.gz 2023-12-06T07:45:16.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118819.log 2023-12-06T07:45:16.088 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155785.log.gz 2023-12-06T07:45:16.088 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149763.log 2023-12-06T07:45:16.089 INFO:teuthology.orchestra.run.smithi134.stderr: 57.8% -- replaced with /var/log/ceph/ceph-client.admin.135508.log.gz 2023-12-06T07:45:16.089 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123776.log 2023-12-06T07:45:16.089 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118819.log.gz 2023-12-06T07:45:16.089 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131425.log 2023-12-06T07:45:16.089 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149763.log.gz 2023-12-06T07:45:16.089 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126136.log 2023-12-06T07:45:16.089 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123776.log.gz 2023-12-06T07:45:16.089 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119897.log 2023-12-06T07:45:16.089 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.131425.log.gz 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147981.log 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126136.log.gz 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169501.log 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119897.log.gz 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136833.log 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147981.log.gz 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166974.log 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169501.log.gz 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151409.log 2023-12-06T07:45:16.090 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136833.log.gz 2023-12-06T07:45:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151826.log 2023-12-06T07:45:16.091 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166974.log.gz 2023-12-06T07:45:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152137.log 2023-12-06T07:45:16.091 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151409.log.gz 2023-12-06T07:45:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147249.log 2023-12-06T07:45:16.091 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151826.log.gz 2023-12-06T07:45:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133546.log 2023-12-06T07:45:16.091 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152137.log.gz 2023-12-06T07:45:16.091 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131299.log 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147249.log.gz 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152718.log 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133546.log.gz 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120011.log 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131299.log.gz 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125656.log 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152718.log.gz 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155197.log 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr: 3.8% -- replaced with /var/log/ceph/ceph-client.admin.120011.log.gz 2023-12-06T07:45:16.092 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128312.log 2023-12-06T07:45:16.093 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125656.log.gz 2023-12-06T07:45:16.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141227.log 2023-12-06T07:45:16.093 INFO:teuthology.orchestra.run.smithi134.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.155197.log.gz 2023-12-06T07:45:16.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147421.log 2023-12-06T07:45:16.093 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128312.log.gz 2023-12-06T07:45:16.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123116.log 2023-12-06T07:45:16.093 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141227.log.gz 2023-12-06T07:45:16.093 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149340.log 2023-12-06T07:45:16.093 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147421.log.gz 2023-12-06T07:45:16.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152675.log 2023-12-06T07:45:16.094 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123116.log.gz 2023-12-06T07:45:16.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156021.log 2023-12-06T07:45:16.094 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149340.log.gz 2023-12-06T07:45:16.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152675.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.127316.log -- replaced with /var/log/ceph/ceph-client.admin.152675.log.gz 2023-12-06T07:45:16.094 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124415.log 2023-12-06T07:45:16.094 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156021.log.gz 2023-12-06T07:45:16.094 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127096.log 2023-12-06T07:45:16.095 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127316.log.gz 2023-12-06T07:45:16.095 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128805.log 2023-12-06T07:45:16.095 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124415.log.gz 2023-12-06T07:45:16.095 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138925.log 2023-12-06T07:45:16.095 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127096.log.gz 2023-12-06T07:45:16.095 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131931.log 2023-12-06T07:45:16.095 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128805.log.gz 2023-12-06T07:45:16.095 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140626.log 2023-12-06T07:45:16.095 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138925.log.gz 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128635.log 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131931.log.gz 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133138.log 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140626.log.gz 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149168.log 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128635.log.gz 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149801.log 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133138.log.gz 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147335.log 2023-12-06T07:45:16.096 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149168.log.gz 2023-12-06T07:45:16.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131509.log 2023-12-06T07:45:16.097 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149801.log.gz 2023-12-06T07:45:16.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158488.log 2023-12-06T07:45:16.097 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147335.log.gz 2023-12-06T07:45:16.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128941.log 2023-12-06T07:45:16.097 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131509.log.gz 2023-12-06T07:45:16.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129417.log 2023-12-06T07:45:16.097 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158488.log.gz 2023-12-06T07:45:16.097 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130732.log 2023-12-06T07:45:16.098 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128941.log.gz 2023-12-06T07:45:16.098 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135553.log 2023-12-06T07:45:16.098 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129417.log.gz 2023-12-06T07:45:16.098 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122957.log 2023-12-06T07:45:16.098 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.130732.log.gz 2023-12-06T07:45:16.098 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154154.log 2023-12-06T07:45:16.098 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135553.log.gz 2023-12-06T07:45:16.098 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135377.log 2023-12-06T07:45:16.099 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122957.log.gz 2023-12-06T07:45:16.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154154.log.gz 2023-12-06T07:45:16.099 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132911.log 2023-12-06T07:45:16.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150279.log 2023-12-06T07:45:16.099 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135377.log.gz 2023-12-06T07:45:16.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150730.log 2023-12-06T07:45:16.099 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132911.log.gz 2023-12-06T07:45:16.099 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145899.log 2023-12-06T07:45:16.099 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150279.log.gz 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129871.log 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150730.log.gz 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141505.log 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145899.log.gz 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147852.log 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129871.log.gz 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120321.log 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141505.log.gz 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132383.log 2023-12-06T07:45:16.100 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147852.log.gz 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155886.log 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120321.log.gz 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117413.log 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132383.log.gz 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162071.log 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155886.log.gz 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160895.log 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117413.log.gz 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160399.log 2023-12-06T07:45:16.101 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162071.log.gz 2023-12-06T07:45:16.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128720.log 2023-12-06T07:45:16.102 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160895.log.gz 2023-12-06T07:45:16.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167178.log 2023-12-06T07:45:16.102 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160399.log.gz 2023-12-06T07:45:16.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162848.log 2023-12-06T07:45:16.102 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128720.log.gz 2023-12-06T07:45:16.102 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126496.log 2023-12-06T07:45:16.102 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167178.log.gz 2023-12-06T07:45:16.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158876.log 2023-12-06T07:45:16.103 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162848.log.gz 2023-12-06T07:45:16.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142934.log 2023-12-06T07:45:16.103 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126496.log.gz 2023-12-06T07:45:16.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142323.log 2023-12-06T07:45:16.103 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158876.log.gz 2023-12-06T07:45:16.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132834.log 2023-12-06T07:45:16.103 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142934.log.gz 2023-12-06T07:45:16.103 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128890.log 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142323.log.gz 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140994.log 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132834.log.gz 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153277.log 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128890.log.gz 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125146.log 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140994.log.gz 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153277.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.109437.log 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153277.log.gz 2023-12-06T07:45:16.104 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121969.log 2023-12-06T07:45:16.105 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125146.log.gz 2023-12-06T07:45:16.105 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.tmp-client.admin.109437.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.109437.log.gz 2023-12-06T07:45:16.105 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130585.log 2023-12-06T07:45:16.105 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121969.log.gz 2023-12-06T07:45:16.105 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122828.log 2023-12-06T07:45:16.105 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154270.log 2023-12-06T07:45:16.105 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130585.log.gz 2023-12-06T07:45:16.105 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132683.log 2023-12-06T07:45:16.105 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122828.log.gz 2023-12-06T07:45:16.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141248.log 2023-12-06T07:45:16.106 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154270.log.gz 2023-12-06T07:45:16.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153803.log 2023-12-06T07:45:16.106 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132683.log.gz 2023-12-06T07:45:16.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136152.log 2023-12-06T07:45:16.106 INFO:teuthology.orchestra.run.smithi134.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.141248.log.gz 2023-12-06T07:45:16.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126916.log 2023-12-06T07:45:16.106 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153803.log.gz 2023-12-06T07:45:16.106 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136696.log 2023-12-06T07:45:16.107 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136152.log.gz 2023-12-06T07:45:16.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153255.log 2023-12-06T07:45:16.107 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126916.log.gz 2023-12-06T07:45:16.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139811.log 2023-12-06T07:45:16.107 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136696.log.gz 2023-12-06T07:45:16.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165813.log 2023-12-06T07:45:16.107 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153255.log.gz 2023-12-06T07:45:16.107 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126796.log 2023-12-06T07:45:16.107 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139811.log.gz 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120069.log 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165813.log.gz 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146682.log 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126796.log.gz 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150257.log 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120069.log.gz 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169444.log 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr: 3.8% -- replaced with /var/log/ceph/ceph-client.admin.146682.log.gz 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150257.log.gz 2023-12-06T07:45:16.108 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142725.log 2023-12-06T07:45:16.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153708.log 2023-12-06T07:45:16.109 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169444.log.gz 2023-12-06T07:45:16.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134639.log 2023-12-06T07:45:16.109 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142725.log.gz 2023-12-06T07:45:16.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132039.log 2023-12-06T07:45:16.109 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153708.log.gz 2023-12-06T07:45:16.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154501.log 2023-12-06T07:45:16.109 INFO:teuthology.orchestra.run.smithi134.stderr: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.134639.log.gz 2023-12-06T07:45:16.109 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160583.log 2023-12-06T07:45:16.110 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132039.log.gz 2023-12-06T07:45:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145961.log 2023-12-06T07:45:16.110 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154501.log.gz 2023-12-06T07:45:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118690.log 2023-12-06T07:45:16.110 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160583.log.gz 2023-12-06T07:45:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120107.log 2023-12-06T07:45:16.110 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145961.log.gz 2023-12-06T07:45:16.110 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169697.log 2023-12-06T07:45:16.110 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118690.log.gz 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127476.log 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120107.log.gz 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158049.log 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169697.log.gz 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163089.log 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127476.log.gz 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168027.log 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158049.log.gz 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.163089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122377.log 2023-12-06T07:45:16.111 INFO:teuthology.orchestra.run.smithi134.stderr: 10.9% -- replaced with /var/log/ceph/ceph-client.admin.163089.log.gz 2023-12-06T07:45:16.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128091.log 2023-12-06T07:45:16.112 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168027.log.gz 2023-12-06T07:45:16.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161770.log 2023-12-06T07:45:16.112 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122377.log.gz 2023-12-06T07:45:16.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159066.log 2023-12-06T07:45:16.112 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128091.log.gz 2023-12-06T07:45:16.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136633.log 2023-12-06T07:45:16.112 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161770.log.gz 2023-12-06T07:45:16.112 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137953.log 2023-12-06T07:45:16.113 INFO:teuthology.orchestra.run.smithi134.stderr: 54.7% -- replaced with /var/log/ceph/ceph-client.admin.159066.log.gz 2023-12-06T07:45:16.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148368.log 2023-12-06T07:45:16.113 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136633.log.gz 2023-12-06T07:45:16.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122936.log 2023-12-06T07:45:16.113 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137953.log.gz 2023-12-06T07:45:16.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148368.log.gz 2023-12-06T07:45:16.113 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166417.log 2023-12-06T07:45:16.113 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150923.log 2023-12-06T07:45:16.113 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122936.log.gz 2023-12-06T07:45:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141850.log 2023-12-06T07:45:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166417.log.gz 2023-12-06T07:45:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155449.log 2023-12-06T07:45:16.114 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150923.log.gz 2023-12-06T07:45:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118991.log 2023-12-06T07:45:16.114 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141850.log.gz 2023-12-06T07:45:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166467.log 2023-12-06T07:45:16.114 INFO:teuthology.orchestra.run.smithi134.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.155449.log.gz 2023-12-06T07:45:16.114 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130312.log 2023-12-06T07:45:16.115 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118991.log.gz 2023-12-06T07:45:16.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145647.log 2023-12-06T07:45:16.115 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166467.log.gz 2023-12-06T07:45:16.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151348.log 2023-12-06T07:45:16.115 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130312.log.gz 2023-12-06T07:45:16.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149598.log 2023-12-06T07:45:16.115 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145647.log.gz 2023-12-06T07:45:16.115 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130606.log 2023-12-06T07:45:16.115 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151348.log.gz 2023-12-06T07:45:16.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142216.log 2023-12-06T07:45:16.116 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149598.log.gz 2023-12-06T07:45:16.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128261.log 2023-12-06T07:45:16.116 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.130606.log.gz 2023-12-06T07:45:16.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124908.log 2023-12-06T07:45:16.116 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142216.log.gz 2023-12-06T07:45:16.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152008.log 2023-12-06T07:45:16.116 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128261.log.gz 2023-12-06T07:45:16.116 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139080.log 2023-12-06T07:45:16.117 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124908.log.gz 2023-12-06T07:45:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124013.log 2023-12-06T07:45:16.117 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152008.log.gz 2023-12-06T07:45:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139899.log 0.0% 2023-12-06T07:45:16.117 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.139080.log.gz 2023-12-06T07:45:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168076.log 2023-12-06T07:45:16.117 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124013.log.gz 2023-12-06T07:45:16.117 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124653.log 2023-12-06T07:45:16.118 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139899.log.gz 2023-12-06T07:45:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164784.log 2023-12-06T07:45:16.118 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168076.log.gz 2023-12-06T07:45:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142641.log 2023-12-06T07:45:16.118 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124653.log.gz 2023-12-06T07:45:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.164784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160979.log 2023-12-06T07:45:16.118 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164784.log.gz 2023-12-06T07:45:16.118 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154132.log 2023-12-06T07:45:16.118 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142641.log.gz 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160979.log.gz 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129451.log 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131804.log 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.154132.log.gz 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168231.log 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129451.log.gz 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156979.log 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131804.log.gz 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119973.log 2023-12-06T07:45:16.119 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168231.log.gz 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157898.log 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156979.log.gz 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149147.log 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119973.log.gz 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141806.log 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157898.log.gz 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140855.log 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149147.log.gz 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141936.log 2023-12-06T07:45:16.120 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141806.log.gz 2023-12-06T07:45:16.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155115.log 2023-12-06T07:45:16.121 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.140855.log.gz 2023-12-06T07:45:16.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138147.log 2023-12-06T07:45:16.121 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141936.log.gz 2023-12-06T07:45:16.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123460.log 2023-12-06T07:45:16.121 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155115.log.gz 2023-12-06T07:45:16.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124449.log 2023-12-06T07:45:16.121 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138147.log.gz 2023-12-06T07:45:16.121 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159905.log 2023-12-06T07:45:16.122 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123460.log.gz 2023-12-06T07:45:16.122 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158343.log 2023-12-06T07:45:16.122 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124449.log.gz 2023-12-06T07:45:16.122 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159926.log 2023-12-06T07:45:16.122 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159905.log.gz 2023-12-06T07:45:16.122 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157472.log 2023-12-06T07:45:16.122 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158343.log.gz 2023-12-06T07:45:16.122 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156806.log 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159926.log.gz 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162762.log 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157472.log.gz 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119531.log 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156806.log.gz 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154173.log 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162762.log.gz 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121604.log 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.119531.log.gz 2023-12-06T07:45:16.123 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154173.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-06T07:45:16.124 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154173.log.gz 2023-12-06T07:45:16.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165715.log 2023-12-06T07:45:16.124 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121604.log.gz 2023-12-06T07:45:16.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126456.log 2023-12-06T07:45:16.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156494.log 2023-12-06T07:45:16.124 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165715.log.gz 2023-12-06T07:45:16.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158832.log 2023-12-06T07:45:16.124 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126456.log.gz 2023-12-06T07:45:16.124 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126176.log 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156494.log.gz 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136513.log 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158832.log.gz 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148470.log 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126176.log.gz 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123442.log 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr: 31.1% -- replaced with /var/log/ceph/ceph-client.admin.136513.log.gz 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147056.log 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148470.log.gz 2023-12-06T07:45:16.125 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123000.log 2023-12-06T07:45:16.126 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123442.log.gz 2023-12-06T07:45:16.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145798.log 2023-12-06T07:45:16.126 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147056.log.gz 2023-12-06T07:45:16.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156473.log 2023-12-06T07:45:16.126 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123000.log.gz 2023-12-06T07:45:16.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130459.log 2023-12-06T07:45:16.126 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145798.log.gz 2023-12-06T07:45:16.126 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161297.log 2023-12-06T07:45:16.126 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156473.log.gz 2023-12-06T07:45:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123862.log 2023-12-06T07:45:16.127 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130459.log.gz 2023-12-06T07:45:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161297.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.161297.log.gz--verbose 2023-12-06T07:45:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.148554.log 2023-12-06T07:45:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152933.log 2023-12-06T07:45:16.127 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123862.log.gz 2023-12-06T07:45:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147938.log 2023-12-06T07:45:16.127 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148554.log.gz 2023-12-06T07:45:16.127 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152933.log.gz 2023-12-06T07:45:16.128 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119917.log 2023-12-06T07:45:16.128 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163145.log 2023-12-06T07:45:16.128 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147938.log.gz 2023-12-06T07:45:16.128 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119917.log.gz 2023-12-06T07:45:16.128 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122764.log 2023-12-06T07:45:16.128 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128584.log 2023-12-06T07:45:16.128 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.163145.log: 64.9% -- replaced with /var/log/ceph/ceph-client.admin.163145.log.gz 2023-12-06T07:45:16.128 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137520.log 2023-12-06T07:45:16.128 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122764.log.gz 2023-12-06T07:45:16.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128584.log.gz 2023-12-06T07:45:16.129 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120639.log 2023-12-06T07:45:16.129 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145023.log 2023-12-06T07:45:16.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137520.log.gz 2023-12-06T07:45:16.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136073.log 2023-12-06T07:45:16.129 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120639.log.gz 2023-12-06T07:45:16.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137434.log 2023-12-06T07:45:16.129 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145023.log.gz 2023-12-06T07:45:16.129 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160937.log 2023-12-06T07:45:16.130 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136073.log.gz 2023-12-06T07:45:16.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137434.log.gz 2023-12-06T07:45:16.130 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141634.log 2023-12-06T07:45:16.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156102.log 2023-12-06T07:45:16.130 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.160937.log.gz 2023-12-06T07:45:16.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151869.log 2023-12-06T07:45:16.130 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141634.log.gz 2023-12-06T07:45:16.130 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154464.log 2023-12-06T07:45:16.130 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156102.log.gz 2023-12-06T07:45:16.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123235.log 2023-12-06T07:45:16.131 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151869.log.gz 2023-12-06T07:45:16.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132875.log 2023-12-06T07:45:16.131 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154464.log.gz 2023-12-06T07:45:16.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145410.log 0.0% 2023-12-06T07:45:16.131 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123235.log.gz 2023-12-06T07:45:16.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138297.log 2023-12-06T07:45:16.131 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132875.log.gz 2023-12-06T07:45:16.131 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145410.log.gz 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161748.log 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121582.log 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138297.log.gz 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149297.log 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161748.log.gz 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140897.log 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121582.log.gz 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149405.log 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149297.log.gz 2023-12-06T07:45:16.132 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142984.log 2023-12-06T07:45:16.133 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.140897.log.gz 2023-12-06T07:45:16.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134436.log 2023-12-06T07:45:16.133 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149405.log.gz 2023-12-06T07:45:16.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142280.log 2023-12-06T07:45:16.133 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142984.log.gz 2023-12-06T07:45:16.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154483.log 2023-12-06T07:45:16.133 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134436.log.gz 2023-12-06T07:45:16.133 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154792.log 2023-12-06T07:45:16.133 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142280.log.gz 2023-12-06T07:45:16.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145858.log 0.0% 2023-12-06T07:45:16.134 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154483.log.gz 2023-12-06T07:45:16.134 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137090.log 2023-12-06T07:45:16.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154792.log.gz 2023-12-06T07:45:16.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145858.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.146536.log -- replaced with /var/log/ceph/ceph-client.admin.145858.log.gz 2023-12-06T07:45:16.134 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125503.log 2023-12-06T07:45:16.134 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137090.log.gz 2023-12-06T07:45:16.134 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146536.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.118970.log -- replaced with /var/log/ceph/ceph-client.admin.146536.log.gz 2023-12-06T07:45:16.135 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129976.log 2023-12-06T07:45:16.135 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125503.log.gz 2023-12-06T07:45:16.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141015.log 2023-12-06T07:45:16.135 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118970.log.gz 2023-12-06T07:45:16.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143672.log 2023-12-06T07:45:16.135 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.129976.log.gz 2023-12-06T07:45:16.135 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141015.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.141015.log.gz-5 2023-12-06T07:45:16.135 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.169191.log 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167423.log 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143672.log.gz 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117805.log 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169191.log.gz 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123387.log 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167423.log.gz 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153019.log 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117805.log.gz 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122613.log 2023-12-06T07:45:16.136 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123387.log.gz 2023-12-06T07:45:16.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153019.log.gz 2023-12-06T07:45:16.137 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127576.log 2023-12-06T07:45:16.137 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151151.log 2023-12-06T07:45:16.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122613.log.gz 2023-12-06T07:45:16.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127976.log 2023-12-06T07:45:16.137 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127576.log.gz 2023-12-06T07:45:16.137 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146348.log 2023-12-06T07:45:16.137 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151151.log.gz 2023-12-06T07:45:16.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120488.log 2023-12-06T07:45:16.138 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127976.log.gz 2023-12-06T07:45:16.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127156.log 2023-12-06T07:45:16.138 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146348.log.gz 2023-12-06T07:45:16.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128142.log 2023-12-06T07:45:16.138 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120488.log.gz 2023-12-06T07:45:16.138 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127156.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.127156.log.gz--verbose 2023-12-06T07:45:16.138 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.147702.log 2023-12-06T07:45:16.138 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125877.log 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128142.log.gz 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122248.log 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147702.log.gz 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148889.log 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125877.log.gz 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122248.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.122248.log.gz--verbose 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.138741.log 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140876.log 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148889.log.gz 2023-12-06T07:45:16.139 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162590.log 2023-12-06T07:45:16.140 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138741.log.gz 2023-12-06T07:45:16.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119400.log 2023-12-06T07:45:16.140 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140876.log.gz 2023-12-06T07:45:16.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155409.log 2023-12-06T07:45:16.140 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162590.log.gz 2023-12-06T07:45:16.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119400.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.156003.log 2023-12-06T07:45:16.140 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.119400.log.gz 2023-12-06T07:45:16.140 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156514.log 2023-12-06T07:45:16.140 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155409.log.gz 2023-12-06T07:45:16.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156003.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.156003.log.gz-- 2023-12-06T07:45:16.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134478.log 2023-12-06T07:45:16.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160378.log 2023-12-06T07:45:16.141 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156514.log.gz 2023-12-06T07:45:16.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118712.log 0.0% 2023-12-06T07:45:16.141 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.134478.log.gz 2023-12-06T07:45:16.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145217.log 2023-12-06T07:45:16.141 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160378.log.gz 2023-12-06T07:45:16.141 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158551.log 2023-12-06T07:45:16.142 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118712.log.gz 2023-12-06T07:45:16.142 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147400.log 2023-12-06T07:45:16.142 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145217.log.gz 2023-12-06T07:45:16.142 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156766.log 2023-12-06T07:45:16.142 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158551.log.gz 2023-12-06T07:45:16.142 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143178.log 2023-12-06T07:45:16.142 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147400.log.gz 2023-12-06T07:45:16.142 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156766.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.156766.log.gz/var/log/ceph/ceph-client.admin.119803.log 2023-12-06T07:45:16.142 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157662.log 2023-12-06T07:45:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143178.log.gz 2023-12-06T07:45:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119803.log.gz 2023-12-06T07:45:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131572.log 2023-12-06T07:45:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154033.log 2023-12-06T07:45:16.143 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157662.log.gz 2023-12-06T07:45:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131572.log.gzgzip 2023-12-06T07:45:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.142602.log 2023-12-06T07:45:16.143 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142259.log 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154033.log.gz 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130123.log 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.142602.log.gz 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128975.log 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142259.log.gz 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135954.log 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130123.log.gz 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128975.log.gz 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165254.log 2023-12-06T07:45:16.144 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121926.log 2023-12-06T07:45:16.145 INFO:teuthology.orchestra.run.smithi134.stderr: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.135954.log.gz 2023-12-06T07:45:16.145 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148304.log 2023-12-06T07:45:16.145 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165254.log.gz 2023-12-06T07:45:16.145 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118862.log 2023-12-06T07:45:16.145 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121926.log.gz 2023-12-06T07:45:16.145 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140914.log 2023-12-06T07:45:16.145 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148304.log.gz 2023-12-06T07:45:16.145 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147680.log 2023-12-06T07:45:16.145 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118862.log.gz 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140914.log.gz 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136052.log 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150623.log 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147680.log.gz 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153449.log 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136052.log.gz 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127536.log 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150623.log.gz 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141677.log 2023-12-06T07:45:16.146 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153449.log.gz 2023-12-06T07:45:16.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132469.log 2023-12-06T07:45:16.147 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127536.log.gz 2023-12-06T07:45:16.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132168.log 2023-12-06T07:45:16.147 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141677.log.gz 2023-12-06T07:45:16.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132469.log.gz 2023-12-06T07:45:16.147 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142194.log 2023-12-06T07:45:16.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132168.log.gz 2023-12-06T07:45:16.147 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165666.log 2023-12-06T07:45:16.147 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153782.log 2023-12-06T07:45:16.148 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142194.log.gz 2023-12-06T07:45:16.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144918.log 2023-12-06T07:45:16.148 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165666.log.gz 2023-12-06T07:45:16.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153782.log.gz 2023-12-06T07:45:16.148 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138966.log 2023-12-06T07:45:16.148 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147443.log 2023-12-06T07:45:16.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144918.log: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.144918.log.gz 2023-12-06T07:45:16.148 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135025.log 2023-12-06T07:45:16.148 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138966.log.gz 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137717.log 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147443.log.gz 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156373.log 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135025.log.gz 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137717.log.gz 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131467.log 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150472.log 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156373.log.gz 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131467.log.gz 2023-12-06T07:45:16.149 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121026.log 2023-12-06T07:45:16.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148595.log 2023-12-06T07:45:16.150 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150472.log.gz 2023-12-06T07:45:16.150 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124034.log 2023-12-06T07:45:16.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121026.log.gz 2023-12-06T07:45:16.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148595.log.gz 2023-12-06T07:45:16.150 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127896.log 2023-12-06T07:45:16.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129060.log 2023-12-06T07:45:16.150 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124034.log.gz 2023-12-06T07:45:16.150 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153320.log 2023-12-06T07:45:16.151 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127896.log.gz 2023-12-06T07:45:16.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127616.log 2023-12-06T07:45:16.151 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129060.log.gz 2023-12-06T07:45:16.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124163.log 2023-12-06T07:45:16.151 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153320.log.gz 2023-12-06T07:45:16.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127016.log 2023-12-06T07:45:16.151 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127616.log.gz 2023-12-06T07:45:16.151 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124163.log.gz 2023-12-06T07:45:16.151 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162783.log 2023-12-06T07:45:16.152 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160292.log 2023-12-06T07:45:16.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127016.log.gz 2023-12-06T07:45:16.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121668.log 2023-12-06T07:45:16.152 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162783.log.gz 2023-12-06T07:45:16.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137004.log 2023-12-06T07:45:16.152 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160292.log.gz 2023-12-06T07:45:16.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145238.log 2023-12-06T07:45:16.152 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121668.log.gz 2023-12-06T07:45:16.152 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137004.log.gz 2023-12-06T07:45:16.153 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120467.log 2023-12-06T07:45:16.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153470.log 2023-12-06T07:45:16.153 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145238.log.gz 2023-12-06T07:45:16.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138884.log 2023-12-06T07:45:16.153 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120467.log.gz 2023-12-06T07:45:16.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133971.log 2023-12-06T07:45:16.153 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153470.log.gz 2023-12-06T07:45:16.153 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138884.log.gz 2023-12-06T07:45:16.153 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134840.log 2023-12-06T07:45:16.154 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148282.log 2023-12-06T07:45:16.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133971.log.gz 2023-12-06T07:45:16.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129740.log 2023-12-06T07:45:16.154 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134840.log.gz 2023-12-06T07:45:16.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148282.log.gz 2023-12-06T07:45:16.154 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135191.log 2023-12-06T07:45:16.154 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138828.log 2023-12-06T07:45:16.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129740.log.gz 2023-12-06T07:45:16.154 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127276.log 2023-12-06T07:45:16.155 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135191.log.gz 2023-12-06T07:45:16.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138828.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.138828.log.gz-- 2023-12-06T07:45:16.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158713.log 2023-12-06T07:45:16.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149125.log 2023-12-06T07:45:16.155 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127276.log.gz 2023-12-06T07:45:16.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127516.log 2023-12-06T07:45:16.155 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158713.log.gz 2023-12-06T07:45:16.155 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128754.log 2023-12-06T07:45:16.155 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149125.log.gz 2023-12-06T07:45:16.156 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156842.log 2023-12-06T07:45:16.156 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127516.log.gz 2023-12-06T07:45:16.156 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117560.log 2023-12-06T07:45:16.156 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128754.log.gz 2023-12-06T07:45:16.156 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135003.log 2023-12-06T07:45:16.156 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156842.log.gz 2023-12-06T07:45:16.156 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131131.log 2023-12-06T07:45:16.156 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117560.log.gz 2023-12-06T07:45:16.156 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154994.log 2023-12-06T07:45:16.157 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135003.log.gz 2023-12-06T07:45:16.157 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146162.log 2023-12-06T07:45:16.157 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131131.log.gz 2023-12-06T07:45:16.157 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126836.log 2023-12-06T07:45:16.157 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154994.log.gz 2023-12-06T07:45:16.157 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137176.log 2023-12-06T07:45:16.157 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146162.log.gz 2023-12-06T07:45:16.157 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162006.log 2023-12-06T07:45:16.157 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126836.log.gz 2023-12-06T07:45:16.158 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137176.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.137176.log.gz 2023-12-06T07:45:16.158 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151485.log 2023-12-06T07:45:16.158 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142788.log 2023-12-06T07:45:16.158 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162006.log.gz 2023-12-06T07:45:16.158 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151485.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.151485.log.gz/var/log/ceph/ceph-client.admin.119662.log 2023-12-06T07:45:16.158 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.158 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114261.log 2023-12-06T07:45:16.158 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142788.log.gz 2023-12-06T07:45:16.158 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119662.log.gz 2023-12-06T07:45:16.159 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124755.log 2023-12-06T07:45:16.159 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.114261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128499.log 2023-12-06T07:45:16.159 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114261.log.gz 2023-12-06T07:45:16.159 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169795.log 2023-12-06T07:45:16.159 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124755.log.gz 2023-12-06T07:45:16.159 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128499.log.gz 2023-12-06T07:45:16.159 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162912.log 2023-12-06T07:45:16.159 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130438.log 2023-12-06T07:45:16.159 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169795.log.gz 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137455.log 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162912.log.gz 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141699.log 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130438.log.gz 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160958.log 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137455.log.gz 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141699.log.gz 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142829.log 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159797.log 2023-12-06T07:45:16.160 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160958.log.gz 2023-12-06T07:45:16.161 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156256.log 2023-12-06T07:45:16.161 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142829.log.gz 2023-12-06T07:45:16.161 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143457.log 2023-12-06T07:45:16.161 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159797.log.gz 2023-12-06T07:45:16.161 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130543.log 2023-12-06T07:45:16.161 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156256.log.gz 2023-12-06T07:45:16.161 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151506.log 2023-12-06T07:45:16.161 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143457.log.gz 2023-12-06T07:45:16.161 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155391.log 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130543.log.gz 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151506.log.gz 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134198.log 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146224.log 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155391.log.gz 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131888.log 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.134198.log.gz 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129315.log 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146224.log.gz 2023-12-06T07:45:16.162 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123905.log 2023-12-06T07:45:16.163 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131888.log.gz 2023-12-06T07:45:16.163 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147616.log 2023-12-06T07:45:16.163 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129315.log.gz 2023-12-06T07:45:16.163 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120703.log 2023-12-06T07:45:16.163 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123905.log.gz 2023-12-06T07:45:16.163 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121452.log 2023-12-06T07:45:16.163 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147616.log.gz 2023-12-06T07:45:16.163 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160853.log 0.0% 2023-12-06T07:45:16.163 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120703.log.gz 2023-12-06T07:45:16.164 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153105.log 2023-12-06T07:45:16.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121452.log.gz 2023-12-06T07:45:16.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146661.log 2023-12-06T07:45:16.164 INFO:teuthology.orchestra.run.smithi134.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.160853.log.gz 2023-12-06T07:45:16.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138233.log 0.0% 2023-12-06T07:45:16.164 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.153105.log.gz 2023-12-06T07:45:16.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123081.log 2023-12-06T07:45:16.164 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.146661.log.gz 2023-12-06T07:45:16.164 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128992.log 2023-12-06T07:45:16.165 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138233.log.gz 2023-12-06T07:45:16.165 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164882.log 2023-12-06T07:45:16.165 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.123081.log.gz 2023-12-06T07:45:16.165 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156919.log 2023-12-06T07:45:16.165 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128992.log.gz 2023-12-06T07:45:16.165 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162225.log 2023-12-06T07:45:16.165 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.164882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164882.log.gz 2023-12-06T07:45:16.165 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156919.log.gz 2023-12-06T07:45:16.165 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141141.log 2023-12-06T07:45:16.166 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161136.log 2023-12-06T07:45:16.166 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162225.log.gz 2023-12-06T07:45:16.166 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147314.log 2023-12-06T07:45:16.166 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141141.log.gz 2023-12-06T07:45:16.166 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149512.log 2023-12-06T07:45:16.166 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161136.log.gz 2023-12-06T07:45:16.166 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147314.log.gz 2023-12-06T07:45:16.166 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121374.log 2023-12-06T07:45:16.166 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161619.log 2023-12-06T07:45:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149512.log.gz 2023-12-06T07:45:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121374.log.gz 2023-12-06T07:45:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158631.log 2023-12-06T07:45:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149534.log 2023-12-06T07:45:16.167 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161619.log.gz 2023-12-06T07:45:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167978.log 2023-12-06T07:45:16.167 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158631.log.gz 2023-12-06T07:45:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162826.log 2023-12-06T07:45:16.167 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149534.log.gz 2023-12-06T07:45:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150236.log 2023-12-06T07:45:16.168 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167978.log.gz 2023-12-06T07:45:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141376.log 2023-12-06T07:45:16.168 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162826.log.gz 2023-12-06T07:45:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155546.log 2023-12-06T07:45:16.168 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150236.log.gz 2023-12-06T07:45:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122893.log 2023-12-06T07:45:16.168 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.141376.log.gz 2023-12-06T07:45:16.168 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155546.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.132512.log 2023-12-06T07:45:16.169 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155546.log.gz 2023-12-06T07:45:16.169 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131068.log 2023-12-06T07:45:16.169 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122893.log.gz 2023-12-06T07:45:16.169 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151950.log 2023-12-06T07:45:16.169 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132512.log.gz 2023-12-06T07:45:16.169 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131068.log.gz 2023-12-06T07:45:16.169 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120125.log 2023-12-06T07:45:16.169 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129502.log 2023-12-06T07:45:16.169 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151950.log.gz 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140813.log 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120125.log.gz 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123798.log 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129502.log.gz 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140813.log.gz 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132340.log 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140934.log 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123798.log.gz 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151191.log 2023-12-06T07:45:16.170 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132340.log.gz 2023-12-06T07:45:16.171 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145561.log 2023-12-06T07:45:16.171 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140934.log.gz 2023-12-06T07:45:16.171 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151191.log.gz 2023-12-06T07:45:16.171 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125537.log 2023-12-06T07:45:16.171 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150957.log 2023-12-06T07:45:16.171 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145561.log.gz 2023-12-06T07:45:16.171 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134157.log 2023-12-06T07:45:16.171 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125537.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125537.log.gz 2023-12-06T07:45:16.171 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150957.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.150957.log.gz-5 2023-12-06T07:45:16.172 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.121711.log 2023-12-06T07:45:16.172 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126276.log 2023-12-06T07:45:16.172 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134157.log.gz 2023-12-06T07:45:16.172 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147185.log 2023-12-06T07:45:16.172 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121711.log.gz 2023-12-06T07:45:16.172 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157354.log 2023-12-06T07:45:16.172 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126276.log.gz 2023-12-06T07:45:16.172 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147185.log.gz 2023-12-06T07:45:16.172 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123134.log 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133611.log 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157354.log.gz 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159131.log 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123134.log.gz 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130837.log 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133611.log.gz 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159131.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.159131.log.gz--verbose 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.128414.log 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145921.log 2023-12-06T07:45:16.173 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130837.log.gz 2023-12-06T07:45:16.174 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150214.log 2023-12-06T07:45:16.174 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128414.log.gz 2023-12-06T07:45:16.174 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145921.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.147099.log 2023-12-06T07:45:16.174 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.145921.log.gz 2023-12-06T07:45:16.174 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132404.log 2023-12-06T07:45:16.174 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150214.log.gz 2023-12-06T07:45:16.174 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147099.log.gz 2023-12-06T07:45:16.174 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133482.log 2023-12-06T07:45:16.175 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149961.log 2023-12-06T07:45:16.175 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132404.log.gz 2023-12-06T07:45:16.175 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145152.log 2023-12-06T07:45:16.175 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133482.log.gz 2023-12-06T07:45:16.175 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149719.log 2023-12-06T07:45:16.175 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149961.log.gz 2023-12-06T07:45:16.175 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150773.log 2023-12-06T07:45:16.175 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145152.log.gz 2023-12-06T07:45:16.177 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123884.log 2023-12-06T07:45:16.177 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149719.log.gz 2023-12-06T07:45:16.177 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154917.log 2023-12-06T07:45:16.177 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150773.log.gz 2023-12-06T07:45:16.177 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126996.log 2023-12-06T07:45:16.177 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123884.log.gz 2023-12-06T07:45:16.178 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154917.log.gz 2023-12-06T07:45:16.178 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131910.log 2023-12-06T07:45:16.178 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158959.log 2023-12-06T07:45:16.178 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126996.log.gz 2023-12-06T07:45:16.178 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124823.log 2023-12-06T07:45:16.178 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131910.log.gz 2023-12-06T07:45:16.178 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158959.log.gz 2023-12-06T07:45:16.178 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138319.log 2023-12-06T07:45:16.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134739.log 2023-12-06T07:45:16.179 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124823.log.gz 2023-12-06T07:45:16.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138319.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.138319.log.gz-- 2023-12-06T07:45:16.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119548.log 2023-12-06T07:45:16.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132760.log 2023-12-06T07:45:16.179 INFO:teuthology.orchestra.run.smithi134.stderr: 59.8% -- replaced with /var/log/ceph/ceph-client.admin.134739.log.gz 2023-12-06T07:45:16.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135735.log 2023-12-06T07:45:16.179 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119548.log.gz 2023-12-06T07:45:16.179 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161727.log 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132760.log.gz 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121197.log 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.135735.log.gz 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136271.log 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161727.log.gz 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166671.log 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.121197.log.gz 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152911.log 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136271.log.gz 2023-12-06T07:45:16.180 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161662.log 2023-12-06T07:45:16.181 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166671.log.gz 2023-12-06T07:45:16.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134921.log 2023-12-06T07:45:16.181 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152911.log.gz 2023-12-06T07:45:16.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161533.log 2023-12-06T07:45:16.181 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161662.log.gz 2023-12-06T07:45:16.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134921.log.gz 2023-12-06T07:45:16.181 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149881.log 2023-12-06T07:45:16.181 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128397.log 2023-12-06T07:45:16.181 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161533.log.gz 2023-12-06T07:45:16.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154877.log 2023-12-06T07:45:16.182 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149881.log.gz 2023-12-06T07:45:16.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121819.log 2023-12-06T07:45:16.182 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128397.log.gz 2023-12-06T07:45:16.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154877.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-06T07:45:16.182 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154877.log.gz 2023-12-06T07:45:16.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145367.log 2023-12-06T07:45:16.182 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121819.log.gz 2023-12-06T07:45:16.182 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150193.log 2023-12-06T07:45:16.183 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119745.log 2023-12-06T07:45:16.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145367.log.gz 2023-12-06T07:45:16.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150193.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.150193.log.gz--verbose 2023-12-06T07:45:16.183 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.119688.log 2023-12-06T07:45:16.183 INFO:teuthology.orchestra.run.smithi134.stderr: 89.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-06T07:45:16.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133224.log 2023-12-06T07:45:16.183 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119745.log.gz 2023-12-06T07:45:16.183 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137326.log 2023-12-06T07:45:16.183 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119688.log.gz 2023-12-06T07:45:16.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133224.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.133224.log.gz/var/log/ceph/ceph-client.admin.126956.log 2023-12-06T07:45:16.184 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140792.log 2023-12-06T07:45:16.184 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137326.log.gz 2023-12-06T07:45:16.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125962.log 2023-12-06T07:45:16.184 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126956.log.gz 2023-12-06T07:45:16.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140792.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.124483.log 2023-12-06T07:45:16.184 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140792.log.gz 2023-12-06T07:45:16.184 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125962.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125962.log.gz 2023-12-06T07:45:16.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136918.log 2023-12-06T07:45:16.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124483.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124483.log.gz 2023-12-06T07:45:16.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154113.log 2023-12-06T07:45:16.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132318.log 2023-12-06T07:45:16.185 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136918.log.gz 2023-12-06T07:45:16.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141078.log 2023-12-06T07:45:16.185 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154113.log.gz 2023-12-06T07:45:16.185 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132318.log.gz 2023-12-06T07:45:16.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151969.log 2023-12-06T07:45:16.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165617.log 2023-12-06T07:45:16.186 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141078.log.gz 2023-12-06T07:45:16.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136875.log 2023-12-06T07:45:16.186 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151969.log.gz 2023-12-06T07:45:16.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140161.log 2023-12-06T07:45:16.186 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165617.log.gz 2023-12-06T07:45:16.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134797.log 2023-12-06T07:45:16.186 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136875.log.gz 2023-12-06T07:45:16.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139007.log 2023-12-06T07:45:16.187 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140161.log.gz 2023-12-06T07:45:16.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136654.log 2023-12-06T07:45:16.187 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134797.log.gz 2023-12-06T07:45:16.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124806.log 2023-12-06T07:45:16.187 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139007.log.gz 2023-12-06T07:45:16.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136654.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.136654.log.gz-- 2023-12-06T07:45:16.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160485.log 2023-12-06T07:45:16.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154561.log 2023-12-06T07:45:16.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124806.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124806.log.gz 2023-12-06T07:45:16.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152266.log 2023-12-06T07:45:16.188 INFO:teuthology.orchestra.run.smithi134.stderr: 26.9% -- replaced with /var/log/ceph/ceph-client.admin.160485.log.gz 2023-12-06T07:45:16.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154561.log.gz 2023-12-06T07:45:16.188 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150580.log 2023-12-06T07:45:16.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122183.log 2023-12-06T07:45:16.188 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152266.log.gz 2023-12-06T07:45:16.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136251.log 2023-12-06T07:45:16.188 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150580.log.gz 2023-12-06T07:45:16.188 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155967.log 2023-12-06T07:45:16.189 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122183.log.gz 2023-12-06T07:45:16.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149841.log 2023-12-06T07:45:16.189 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136251.log.gz 2023-12-06T07:45:16.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128448.log 2023-12-06T07:45:16.189 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155967.log.gz 2023-12-06T07:45:16.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122054.log 2023-12-06T07:45:16.189 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149841.log.gz 2023-12-06T07:45:16.189 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131257.log 2023-12-06T07:45:16.189 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128448.log.gz 2023-12-06T07:45:16.190 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122054.log.gz 2023-12-06T07:45:16.190 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125486.log 2023-12-06T07:45:16.190 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158811.log 2023-12-06T07:45:16.190 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131257.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.131257.log.gz 2023-12-06T07:45:16.190 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145453.log 2023-12-06T07:45:16.190 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125486.log.gz 2023-12-06T07:45:16.190 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158811.log.gz 2023-12-06T07:45:16.190 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157140.log 2023-12-06T07:45:16.190 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165960.log 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145453.log.gz 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167831.log 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157140.log.gz 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159561.log 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165960.log.gz 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131762.log 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167831.log.gz 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159561.log.gz 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131719.log 2023-12-06T07:45:16.191 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135855.log 2023-12-06T07:45:16.192 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131762.log.gz 2023-12-06T07:45:16.192 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162676.log 2023-12-06T07:45:16.192 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131719.log.gz 2023-12-06T07:45:16.192 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166311.log 2023-12-06T07:45:16.192 INFO:teuthology.orchestra.run.smithi134.stderr: 54.4% -- replaced with /var/log/ceph/ceph-client.admin.135855.log.gz 2023-12-06T07:45:16.192 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141527.log 2023-12-06T07:45:16.192 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162676.log.gz 2023-12-06T07:45:16.192 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166311.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.157492.log -- replaced with /var/log/ceph/ceph-client.admin.166311.log.gz 2023-12-06T07:45:16.192 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.193 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145758.log 2023-12-06T07:45:16.193 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141527.log.gz 2023-12-06T07:45:16.193 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130816.log 2023-12-06T07:45:16.193 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157492.log.gz 2023-12-06T07:45:16.193 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160730.log 2023-12-06T07:45:16.193 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145758.log.gz 2023-12-06T07:45:16.193 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147917.log 2023-12-06T07:45:16.193 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130816.log.gz 2023-12-06T07:45:16.193 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153341.log 24.1% 2023-12-06T07:45:16.194 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160730.log.gz 2023-12-06T07:45:16.194 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141036.log 2023-12-06T07:45:16.194 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147917.log.gz 2023-12-06T07:45:16.194 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165029.log 2023-12-06T07:45:16.194 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153341.log.gz 2023-12-06T07:45:16.194 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158571.log 2023-12-06T07:45:16.194 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141036.log.gz 2023-12-06T07:45:16.194 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157834.log 2023-12-06T07:45:16.194 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165029.log.gz 2023-12-06T07:45:16.195 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133053.log 2023-12-06T07:45:16.195 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158571.log.gz 2023-12-06T07:45:16.195 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157834.log.gz 2023-12-06T07:45:16.195 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134941.log 2023-12-06T07:45:16.195 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139574.log 2023-12-06T07:45:16.195 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133053.log.gz 2023-12-06T07:45:16.195 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138724.log 2023-12-06T07:45:16.195 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134941.log.gz 2023-12-06T07:45:16.195 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129383.log 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139574.log.gz 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127076.log 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138724.log.gz 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132704.log 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129383.log.gz 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120553.log 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127076.log.gz 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129400.log 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.132704.log.gz 2023-12-06T07:45:16.196 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155743.log 2023-12-06T07:45:16.197 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120553.log.gz 2023-12-06T07:45:16.197 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168791.log 2023-12-06T07:45:16.197 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129400.log.gz 2023-12-06T07:45:16.197 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127936.log 2023-12-06T07:45:16.197 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155743.log.gz 2023-12-06T07:45:16.197 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155034.log 2023-12-06T07:45:16.197 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168791.log.gz 2023-12-06T07:45:16.197 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138986.log 2023-12-06T07:45:16.197 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127936.log.gz 2023-12-06T07:45:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159109.log 2023-12-06T07:45:16.198 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155034.log.gz 2023-12-06T07:45:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127916.log 2023-12-06T07:45:16.198 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138986.log.gz 2023-12-06T07:45:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118297.log 2023-12-06T07:45:16.198 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159109.log.gz 2023-12-06T07:45:16.198 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138125.log 2023-12-06T07:45:16.198 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127916.log.gz 2023-12-06T07:45:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118297.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.151543.log -- replaced with /var/log/ceph/ceph-client.admin.118297.log.gz 2023-12-06T07:45:16.199 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125996.log 2023-12-06T07:45:16.199 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138125.log.gz 2023-12-06T07:45:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169746.log 2023-12-06T07:45:16.199 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151543.log.gz 2023-12-06T07:45:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155219.log 2023-12-06T07:45:16.199 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125996.log.gz 2023-12-06T07:45:16.199 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122312.log 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169746.log.gz 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155219.log.gz 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137219.log 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136775.log 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122312.log.gz 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130501.log 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137219.log.gz 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156216.log 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr: 24.7% -- replaced with /var/log/ceph/ceph-client.admin.136775.log.gz 2023-12-06T07:45:16.200 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133013.log 2023-12-06T07:45:16.201 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130501.log.gz 2023-12-06T07:45:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139295.log 2023-12-06T07:45:16.201 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156216.log.gz 2023-12-06T07:45:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151075.log 2023-12-06T07:45:16.201 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133013.log.gz 2023-12-06T07:45:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152051.log 2023-12-06T07:45:16.201 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139295.log.gz 2023-12-06T07:45:16.201 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168897.log 2023-12-06T07:45:16.201 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151075.log.gz 2023-12-06T07:45:16.202 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152051.log.gz 2023-12-06T07:45:16.202 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157597.log 2023-12-06T07:45:16.202 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167472.log 2023-12-06T07:45:16.202 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168897.log.gz 2023-12-06T07:45:16.202 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139338.log 2023-12-06T07:45:16.202 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157597.log.gz 2023-12-06T07:45:16.202 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124891.log 2023-12-06T07:45:16.202 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167472.log.gz 2023-12-06T07:45:16.202 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139338.log.gz 2023-12-06T07:45:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129638.log 2023-12-06T07:45:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156690.log 2023-12-06T07:45:16.203 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124891.log.gz 2023-12-06T07:45:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129638.log.gz 2023-12-06T07:45:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159883.log 2023-12-06T07:45:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127756.log 2023-12-06T07:45:16.203 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156690.log.gz 2023-12-06T07:45:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159883.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.159883.log.gz-- 2023-12-06T07:45:16.203 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133525.log 2023-12-06T07:45:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129434.log 2023-12-06T07:45:16.204 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127756.log.gz 2023-12-06T07:45:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133525.log.gz 2023-12-06T07:45:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154324.log 2023-12-06T07:45:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158465.log 2023-12-06T07:45:16.204 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129434.log.gz 2023-12-06T07:45:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145625.log 2023-12-06T07:45:16.204 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154324.log.gz 2023-12-06T07:45:16.204 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118927.log 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158465.log.gz 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128703.log 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145625.log.gz 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118927.log.gz 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120617.log 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125707.log 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128703.log.gz 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125197.log 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120617.log.gz 2023-12-06T07:45:16.205 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124857.log 2023-12-06T07:45:16.206 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125707.log.gz 2023-12-06T07:45:16.206 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151726.log 2023-12-06T07:45:16.206 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125197.log.gz 2023-12-06T07:45:16.206 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139682.log 2023-12-06T07:45:16.206 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124857.log.gz 2023-12-06T07:45:16.206 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162439.log 2023-12-06T07:45:16.206 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151726.log.gz 2023-12-06T07:45:16.206 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159367.log 2023-12-06T07:45:16.206 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139682.log.gz 2023-12-06T07:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152159.log 2023-12-06T07:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162439.log.gz 2023-12-06T07:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155663.log 2023-12-06T07:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159367.log.gz 2023-12-06T07:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140954.log 2023-12-06T07:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152159.log.gz 2023-12-06T07:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155354.log 2023-12-06T07:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155663.log.gz 2023-12-06T07:45:16.207 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159754.log 2023-12-06T07:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140954.log.gz 2023-12-06T07:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126032.log 2023-12-06T07:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155354.log.gz 2023-12-06T07:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134261.log 2023-12-06T07:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159754.log.gz 2023-12-06T07:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151170.log 2023-12-06T07:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.126032.log.gz 2023-12-06T07:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160523.log 2023-12-06T07:45:16.208 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134261.log.gz 2023-12-06T07:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125520.log 2023-12-06T07:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151170.log.gz 2023-12-06T07:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147034.log 2023-12-06T07:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160523.log.gz 2023-12-06T07:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150601.log 2023-12-06T07:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125520.log.gz 2023-12-06T07:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156668.log 2023-12-06T07:45:16.209 INFO:teuthology.orchestra.run.smithi134.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.147034.log.gz 2023-12-06T07:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148512.log 2023-12-06T07:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150601.log.gz 2023-12-06T07:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161942.log 2023-12-06T07:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr: 55.5% -- replaced with /var/log/ceph/ceph-client.admin.156668.log.gz 2023-12-06T07:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149383.log 2023-12-06T07:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148512.log.gz 2023-12-06T07:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153824.log 2023-12-06T07:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161942.log.gz 2023-12-06T07:45:16.210 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151213.log 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149383.log.gz 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134033.log 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153824.log.gz 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150101.log 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151213.log.gz 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146327.log 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr: 55.1% -- replaced with /var/log/ceph/ceph-client.admin.134033.log.gz 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141205.log 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.150101.log.gz 2023-12-06T07:45:16.211 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136982.log 2023-12-06T07:45:16.212 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146327.log.gz 2023-12-06T07:45:16.212 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139359.log 2023-12-06T07:45:16.212 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141205.log.gz 2023-12-06T07:45:16.212 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145818.log 2023-12-06T07:45:16.212 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136982.log.gz 2023-12-06T07:45:16.212 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122527.log 2023-12-06T07:45:16.212 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139359.log.gz 2023-12-06T07:45:16.212 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147593.log 2023-12-06T07:45:16.212 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145818.log.gz 2023-12-06T07:45:16.213 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156999.log 2023-12-06T07:45:16.213 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122527.log.gz 2023-12-06T07:45:16.213 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155948.log 2023-12-06T07:45:16.213 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147593.log.gz 2023-12-06T07:45:16.213 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155623.log 2023-12-06T07:45:16.213 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156999.log.gz 2023-12-06T07:45:16.213 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139879.log 2023-12-06T07:45:16.213 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155948.log.gz 2023-12-06T07:45:16.213 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143027.log 2023-12-06T07:45:16.214 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155623.log.gz 2023-12-06T07:45:16.214 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124874.log 2023-12-06T07:45:16.214 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139879.log.gz 2023-12-06T07:45:16.214 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135211.log 2023-12-06T07:45:16.214 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143027.log.gz 2023-12-06T07:45:16.214 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141742.log 2023-12-06T07:45:16.214 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124874.log.gz 2023-12-06T07:45:16.214 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138530.log 2023-12-06T07:45:16.214 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135211.log.gz 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153689.log 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141742.log.gz 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138530.log.gzgzip 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.167627.log 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152954.log 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153689.log.gz 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163038.log 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167627.log.gz 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133929.log 2023-12-06T07:45:16.215 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152954.log.gz 2023-12-06T07:45:16.216 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146991.log 2023-12-06T07:45:16.216 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.163038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163038.log.gz 2023-12-06T07:45:16.216 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114563.log 2023-12-06T07:45:16.216 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133929.log.gz 2023-12-06T07:45:16.216 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134581.log 2023-12-06T07:45:16.216 INFO:teuthology.orchestra.run.smithi134.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.146991.log.gz 2023-12-06T07:45:16.216 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.114563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128856.log 2023-12-06T07:45:16.216 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114563.log.gz 2023-12-06T07:45:16.216 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166818.log 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.134581.log.gz 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147507.log 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128856.log.gz 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142849.log 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166818.log.gz 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134319.log 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147507.log.gz 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137047.log 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142849.log.gz 2023-12-06T07:45:16.217 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134319.log.gz 2023-12-06T07:45:16.218 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132894.log 2023-12-06T07:45:16.218 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133761.log 2023-12-06T07:45:16.218 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137047.log.gz 2023-12-06T07:45:16.218 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155274.log 2023-12-06T07:45:16.218 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132894.log.gz 2023-12-06T07:45:16.218 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137197.log 2023-12-06T07:45:16.218 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133761.log.gz 2023-12-06T07:45:16.218 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160915.log 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155274.log.gz 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148153.log 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137197.log.gz 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126116.log 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160915.log.gz 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148153.log.gz 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161254.log 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129332.log 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126116.log.gz 2023-12-06T07:45:16.219 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159475.log 2023-12-06T07:45:16.220 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161254.log.gz 2023-12-06T07:45:16.220 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148046.log 2023-12-06T07:45:16.220 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129332.log.gz 2023-12-06T07:45:16.220 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159475.log.gz 2023-12-06T07:45:16.220 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123647.log 2023-12-06T07:45:16.220 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148046.log.gz 2023-12-06T07:45:16.220 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151133.log 2023-12-06T07:45:16.220 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161174.log 2023-12-06T07:45:16.220 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123647.log.gz 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138671.log 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151133.log.gz 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151012.log 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.161174.log.gz 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126196.log 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138671.log.gz 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148024.log 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151012.log.gz 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161490.log 2023-12-06T07:45:16.221 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126196.log.gz 2023-12-06T07:45:16.222 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153513.log 2023-12-06T07:45:16.222 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148024.log.gz 2023-12-06T07:45:16.222 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167880.log 2023-12-06T07:45:16.222 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161490.log.gz 2023-12-06T07:45:16.222 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117217.log 2023-12-06T07:45:16.222 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153513.log.gz 2023-12-06T07:45:16.222 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127356.log 2023-12-06T07:45:16.222 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167880.log.gz 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117217.log.gz 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126636.log 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166213.log 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127356.log.gz 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156393.log 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126636.log.gz 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156353.log 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166213.log.gz 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129842.log 2023-12-06T07:45:16.223 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156393.log.gz 2023-12-06T07:45:16.224 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146122.log 2023-12-06T07:45:16.224 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156353.log.gz 2023-12-06T07:45:16.224 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149039.log 2023-12-06T07:45:16.224 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129842.log.gz 2023-12-06T07:45:16.224 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159776.log 2023-12-06T07:45:16.224 INFO:teuthology.orchestra.run.smithi134.stderr: 27.2% -- replaced with /var/log/ceph/ceph-client.admin.146122.log.gz 2023-12-06T07:45:16.224 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149039.log.gz 2023-12-06T07:45:16.224 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157984.log 2023-12-06T07:45:16.224 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153960.log 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159776.log.gz 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125010.log 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157984.log.gz 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159862.log 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153960.log.gz 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123561.log 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125010.log.gz 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152868.log 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159862.log.gz 2023-12-06T07:45:16.225 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122850.log 2023-12-06T07:45:16.226 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123561.log.gz 2023-12-06T07:45:16.226 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135419.log 2023-12-06T07:45:16.226 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152868.log.gz 2023-12-06T07:45:16.226 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124347.log 2023-12-06T07:45:16.226 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122850.log.gz 2023-12-06T07:45:16.226 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157941.log 2023-12-06T07:45:16.226 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135419.log.gz 2023-12-06T07:45:16.226 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121214.log 2023-12-06T07:45:16.226 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124347.log.gz 2023-12-06T07:45:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161056.log 2023-12-06T07:45:16.227 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157941.log.gz 2023-12-06T07:45:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156610.log 2023-12-06T07:45:16.227 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121214.log.gz 2023-12-06T07:45:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161056.log.gz 2023-12-06T07:45:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158733.log 2023-12-06T07:45:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154674.log 2023-12-06T07:45:16.227 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156610.log.gz 2023-12-06T07:45:16.227 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143543.log 2023-12-06T07:45:16.228 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158733.log.gz 2023-12-06T07:45:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152761.log 2023-12-06T07:45:16.228 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154674.log.gz 2023-12-06T07:45:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163106.log 2023-12-06T07:45:16.228 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143543.log.gz 2023-12-06T07:45:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148700.log 2023-12-06T07:45:16.228 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152761.log.gz 2023-12-06T07:45:16.228 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.163106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149061.log 2023-12-06T07:45:16.228 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163106.log.gz 2023-12-06T07:45:16.229 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162568.log 2023-12-06T07:45:16.229 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148700.log.gz 2023-12-06T07:45:16.229 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144980.log 2023-12-06T07:45:16.229 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149061.log.gz 2023-12-06T07:45:16.229 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120725.log 2023-12-06T07:45:16.229 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162568.log.gz 2023-12-06T07:45:16.229 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142108.log 2023-12-06T07:45:16.229 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144980.log.gz 2023-12-06T07:45:16.229 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145878.log 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120725.log.gz 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143694.log 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142108.log.gz 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137240.log 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145878.log.gz 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160141.log 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143694.log.gz 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123098.log 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137240.log.gz 2023-12-06T07:45:16.230 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134137.log 2023-12-06T07:45:16.231 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160141.log.gz 2023-12-06T07:45:16.231 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161576.log 2023-12-06T07:45:16.231 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123098.log.gz 2023-12-06T07:45:16.231 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145941.log 2023-12-06T07:45:16.231 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134137.log.gz 2023-12-06T07:45:16.231 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126936.log 2023-12-06T07:45:16.231 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161576.log.gz 2023-12-06T07:45:16.231 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160710.log 2023-12-06T07:45:16.231 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145941.log.gz 2023-12-06T07:45:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143113.log 2023-12-06T07:45:16.232 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126936.log.gz 2023-12-06T07:45:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121272.log 2023-12-06T07:45:16.232 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160710.log.gz 2023-12-06T07:45:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118101.log 2023-12-06T07:45:16.232 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143113.log.gz 2023-12-06T07:45:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140120.log 2023-12-06T07:45:16.232 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121272.log.gz 2023-12-06T07:45:16.232 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125775.log 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118101.log.gz 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150494.log 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140120.log.gz 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134776.log 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125775.log.gz 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122570.log 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150494.log.gz 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132855.log 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.134776.log.gz 2023-12-06T07:45:16.233 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125605.log 2023-12-06T07:45:16.234 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122570.log.gz 2023-12-06T07:45:16.234 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132855.log.gz 2023-12-06T07:45:16.234 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134116.log 2023-12-06T07:45:16.234 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131215.log 2023-12-06T07:45:16.234 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125605.log.gz 2023-12-06T07:45:16.234 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157920.log 2023-12-06T07:45:16.234 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134116.log.gz 2023-12-06T07:45:16.234 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134721.log 2023-12-06T07:45:16.235 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131215.log.gz 2023-12-06T07:45:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157920.log.gz 2023-12-06T07:45:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153062.log 2023-12-06T07:45:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120301.log 2023-12-06T07:45:16.235 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134721.log.gz 2023-12-06T07:45:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153062.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.153062.log.gz--verbose 2023-12-06T07:45:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.160563.log 2023-12-06T07:45:16.235 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126296.log 2023-12-06T07:45:16.235 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120301.log.gz 2023-12-06T07:45:16.236 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124205.log 2023-12-06T07:45:16.236 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160563.log.gz 2023-12-06T07:45:16.236 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125078.log 2023-12-06T07:45:16.236 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126296.log.gz 2023-12-06T07:45:16.236 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119765.log 2023-12-06T07:45:16.236 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124205.log.gz 2023-12-06T07:45:16.236 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130333.log 2023-12-06T07:45:16.236 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125078.log.gz 2023-12-06T07:45:16.236 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161834.log 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119765.log.gz 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158591.log 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130333.log.gz 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121112.log 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161834.log.gz 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161985.log 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158591.log.gz 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126576.log 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121112.log.gz 2023-12-06T07:45:16.237 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142517.log 2023-12-06T07:45:16.238 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161985.log.gz 2023-12-06T07:45:16.238 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133589.log 2023-12-06T07:45:16.238 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126576.log.gz 2023-12-06T07:45:16.238 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132490.log 2023-12-06T07:45:16.238 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142517.log.gz 2023-12-06T07:45:16.238 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154287.log 2023-12-06T07:45:16.238 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133589.log.gz 2023-12-06T07:45:16.238 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135574.log 2023-12-06T07:45:16.238 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132490.log.gz 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140203.log 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154287.log.gz 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141398.log 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.135574.log.gz 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119292.log 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140203.log.gz 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135108.log 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141398.log.gz 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153148.log 2023-12-06T07:45:16.239 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119292.log.gz 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140706.log 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.135108.log.gz 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156061.log 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153148.log.gz 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125435.log 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140706.log.gz 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138689.log 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.156061.log.gz 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139919.log 2023-12-06T07:45:16.240 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125435.log.gz 2023-12-06T07:45:16.241 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144359.log 2023-12-06T07:45:16.241 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138689.log.gz 2023-12-06T07:45:16.241 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145281.log 2023-12-06T07:45:16.241 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139919.log.gz 2023-12-06T07:45:16.241 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126776.log 2023-12-06T07:45:16.241 INFO:teuthology.orchestra.run.smithi134.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.144359.log.gz 2023-12-06T07:45:16.241 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145260.log 2023-12-06T07:45:16.241 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145281.log.gz 2023-12-06T07:45:16.241 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126616.log 2023-12-06T07:45:16.242 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126776.log.gz 2023-12-06T07:45:16.242 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145174.log 2023-12-06T07:45:16.242 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145260.log.gz 2023-12-06T07:45:16.242 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158853.log 2023-12-06T07:45:16.242 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126616.log.gz 2023-12-06T07:45:16.242 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126736.log 2023-12-06T07:45:16.242 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145174.log.gz 2023-12-06T07:45:16.242 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161813.log 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158853.log.gz 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143629.log 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126736.log.gz 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150709.log 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161813.log.gz 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162027.log 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143629.log.gz 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150709.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.150709.log.gz--verbose 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.134219.log 2023-12-06T07:45:16.243 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132555.log 2023-12-06T07:45:16.244 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162027.log.gz 2023-12-06T07:45:16.244 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154071.log 2023-12-06T07:45:16.244 INFO:teuthology.orchestra.run.smithi134.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.134219.log.gz 2023-12-06T07:45:16.244 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153556.log 2023-12-06T07:45:16.244 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132555.log.gz 2023-12-06T07:45:16.244 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146699.log 2023-12-06T07:45:16.244 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154071.log.gz 2023-12-06T07:45:16.244 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148175.log 2023-12-06T07:45:16.244 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153556.log.gz 2023-12-06T07:45:16.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162375.log 2023-12-06T07:45:16.245 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146699.log.gz 2023-12-06T07:45:16.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120596.log 2023-12-06T07:45:16.245 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148175.log.gz 2023-12-06T07:45:16.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151427.log 2023-12-06T07:45:16.245 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162375.log.gz 2023-12-06T07:45:16.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162977.log 2023-12-06T07:45:16.245 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120596.log.gz 2023-12-06T07:45:16.245 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160464.log 2023-12-06T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151427.log.gz 2023-12-06T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161705.log 2023-12-06T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162977.log.gz 2023-12-06T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160464.log.gz 2023-12-06T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138582.log 2023-12-06T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123287.log 2023-12-06T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161705.log.gz 2023-12-06T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152352.log 2023-12-06T07:45:16.246 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138582.log.gz 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148804.log 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123287.log.gz 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134075.log 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152352.log.gz 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166867.log 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148804.log.gz 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160421.log 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr: 60.0% -- replaced with /var/log/ceph/ceph-client.admin.134075.log.gz 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125231.log 2023-12-06T07:45:16.247 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166867.log.gz 2023-12-06T07:45:16.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152245.log 2023-12-06T07:45:16.248 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160421.log.gz 2023-12-06T07:45:16.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158156.log 2023-12-06T07:45:16.248 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125231.log.gz 2023-12-06T07:45:16.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142130.log 2023-12-06T07:45:16.248 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152245.log.gz 2023-12-06T07:45:16.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158156.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-06T07:45:16.248 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158156.log.gz 2023-12-06T07:45:16.248 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158199.log 2023-12-06T07:45:16.249 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142130.log.gz 2023-12-06T07:45:16.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146392.log 2023-12-06T07:45:16.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157119.log 2023-12-06T07:45:16.249 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158199.log.gz 2023-12-06T07:45:16.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124291.log 2023-12-06T07:45:16.249 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146392.log.gz 2023-12-06T07:45:16.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157119.log.gz 2023-12-06T07:45:16.249 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151990.log 2023-12-06T07:45:16.249 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167276.log 2023-12-06T07:45:16.250 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124291.log.gz 2023-12-06T07:45:16.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123174.log 2023-12-06T07:45:16.250 INFO:teuthology.orchestra.run.smithi134.stderr: 10.7% -- replaced with /var/log/ceph/ceph-client.admin.151990.log.gz 2023-12-06T07:45:16.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148110.log 2023-12-06T07:45:16.250 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167276.log.gz 2023-12-06T07:45:16.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149190.log 2023-12-06T07:45:16.250 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123174.log.gz 2023-12-06T07:45:16.250 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162740.log 2023-12-06T07:45:16.250 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148110.log.gz 2023-12-06T07:45:16.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146719.log 2023-12-06T07:45:16.251 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149190.log.gz 2023-12-06T07:45:16.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125316.log 2023-12-06T07:45:16.251 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162740.log.gz 2023-12-06T07:45:16.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145604.log 2023-12-06T07:45:16.251 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146719.log.gz 2023-12-06T07:45:16.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146472.log 2023-12-06T07:45:16.251 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125316.log.gz 2023-12-06T07:45:16.251 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125979.log 2023-12-06T07:45:16.252 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145604.log.gz 2023-12-06T07:45:16.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148741.log 2023-12-06T07:45:16.252 INFO:teuthology.orchestra.run.smithi134.stderr: 27.3% -- replaced with /var/log/ceph/ceph-client.admin.146472.log.gz 2023-12-06T07:45:16.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153979.log 2023-12-06T07:45:16.252 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125979.log.gz 2023-12-06T07:45:16.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145109.log 2023-12-06T07:45:16.252 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148741.log.gz 2023-12-06T07:45:16.252 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153979.log.gz 2023-12-06T07:45:16.252 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149641.log 2023-12-06T07:45:16.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124704.log 2023-12-06T07:45:16.253 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145109.log.gz 2023-12-06T07:45:16.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149641.log.gz 2023-12-06T07:45:16.253 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125214.log 2023-12-06T07:45:16.253 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157300.log 2023-12-06T07:45:16.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124704.log.gz 2023-12-06T07:45:16.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125214.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125214.log.gz 2023-12-06T07:45:16.253 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147077.log 2023-12-06T07:45:16.253 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122420.log 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157300.log.gz 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166573.log 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147077.log.gz 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129077.log 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122420.log.gz 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166573.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.166573.log.gz-5 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.121474.log 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143436.log 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129077.log.gz 2023-12-06T07:45:16.254 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162289.log 2023-12-06T07:45:16.255 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121474.log.gz 2023-12-06T07:45:16.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159647.log 2023-12-06T07:45:16.255 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143436.log.gz 2023-12-06T07:45:16.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162289.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.162289.log.gz--verbose 2023-12-06T07:45:16.255 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.148389.log 2023-12-06T07:45:16.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122871.log 2023-12-06T07:45:16.255 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159647.log.gz 2023-12-06T07:45:16.255 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159410.log 2023-12-06T07:45:16.255 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148389.log.gz 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121340.log 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122871.log.gz 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128244.log 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159410.log.gz 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153126.log 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121340.log.gz 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128244.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.141270.log 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128244.log.gz 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160163.log 2023-12-06T07:45:16.256 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153126.log.gz 2023-12-06T07:45:16.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155566.log 2023-12-06T07:45:16.257 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141270.log.gz 2023-12-06T07:45:16.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147292.log 2023-12-06T07:45:16.257 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160163.log.gz 2023-12-06T07:45:16.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135937.log 2023-12-06T07:45:16.257 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155566.log.gz 2023-12-06T07:45:16.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165303.log 2023-12-06T07:45:16.257 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147292.log.gz 2023-12-06T07:45:16.257 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162047.log 2023-12-06T07:45:16.258 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.135937.log.gz 2023-12-06T07:45:16.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159023.log 2023-12-06T07:45:16.258 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165303.log.gz 2023-12-06T07:45:16.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158423.log 2023-12-06T07:45:16.258 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162047.log.gz 2023-12-06T07:45:16.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133374.log 2023-12-06T07:45:16.258 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.159023.log.gz 2023-12-06T07:45:16.258 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124551.log 2023-12-06T07:45:16.258 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158423.log.gz 2023-12-06T07:45:16.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129179.log 2023-12-06T07:45:16.259 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133374.log.gz 2023-12-06T07:45:16.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127456.log 2023-12-06T07:45:16.259 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124551.log.gz 2023-12-06T07:45:16.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128346.log 2023-12-06T07:45:16.259 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129179.log.gz 2023-12-06T07:45:16.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161899.log 2023-12-06T07:45:16.259 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127456.log.gz 2023-12-06T07:45:16.259 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136094.log 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr: 27.3% -- replaced with /var/log/ceph/ceph-client.admin.128346.log.gz 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147723.log 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161899.log.gz 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136094.log.gz 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158306.log 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127856.log 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147723.log.gz 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137348.log 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158306.log.gz 2023-12-06T07:45:16.260 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168533.log 2023-12-06T07:45:16.261 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127856.log.gz 2023-12-06T07:45:16.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156533.log 2023-12-06T07:45:16.261 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137348.log.gz 2023-12-06T07:45:16.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132082.log 2023-12-06T07:45:16.261 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168533.log.gz 2023-12-06T07:45:16.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141057.log 2023-12-06T07:45:16.261 INFO:teuthology.orchestra.run.smithi134.stderr: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.156533.log.gz 2023-12-06T07:45:16.261 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133675.log 2023-12-06T07:45:16.261 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132082.log.gz 2023-12-06T07:45:16.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160335.log 2023-12-06T07:45:16.262 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141057.log.gz 2023-12-06T07:45:16.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147120.log 2023-12-06T07:45:16.262 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133675.log.gz 2023-12-06T07:45:16.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136754.log 2023-12-06T07:45:16.262 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160335.log.gz 2023-12-06T07:45:16.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151252.log 2023-12-06T07:45:16.262 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.147120.log.gz 2023-12-06T07:45:16.262 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136754.log.gz 2023-12-06T07:45:16.263 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154595.log 2023-12-06T07:45:16.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126216.log 2023-12-06T07:45:16.263 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151252.log.gz 2023-12-06T07:45:16.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155583.log 2023-12-06T07:45:16.263 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154595.log.gz 2023-12-06T07:45:16.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119494.log 2023-12-06T07:45:16.263 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126216.log.gz 2023-12-06T07:45:16.263 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136592.log 2023-12-06T07:45:16.263 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155583.log.gz 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168681.log 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119494.log.gz 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153040.log 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.136592.log.gz 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161116.log 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168681.log.gz 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157963.log 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153040.log.gz 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118905.log 2023-12-06T07:45:16.264 INFO:teuthology.orchestra.run.smithi134.stderr: 10.2% -- replaced with /var/log/ceph/ceph-client.admin.161116.log.gz 2023-12-06T07:45:16.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157963.log.gz 2023-12-06T07:45:16.265 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157435.log 2023-12-06T07:45:16.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145002.log 2023-12-06T07:45:16.265 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118905.log.gz 2023-12-06T07:45:16.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162998.log 2023-12-06T07:45:16.265 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157435.log.gz 2023-12-06T07:45:16.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121251.log 2023-12-06T07:45:16.265 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145002.log.gz 2023-12-06T07:45:16.265 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122721.log 2023-12-06T07:45:16.266 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162998.log.gz 2023-12-06T07:45:16.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136496.log 2023-12-06T07:45:16.266 INFO:teuthology.orchestra.run.smithi134.stderr: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.121251.log.gz 2023-12-06T07:45:16.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124270.log 2023-12-06T07:45:16.266 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122721.log.gz 2023-12-06T07:45:16.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126236.log 2023-12-06T07:45:16.266 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136496.log.gz 2023-12-06T07:45:16.266 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146492.log 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124270.log.gz 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128125.log 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126236.log.gz 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122355.log 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146492.log.gz 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131614.log 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128125.log.gz 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129485.log 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122355.log.gz 2023-12-06T07:45:16.267 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157619.log 2023-12-06T07:45:16.268 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131614.log.gz 2023-12-06T07:45:16.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145066.log 2023-12-06T07:45:16.268 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129485.log.gz 2023-12-06T07:45:16.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125350.log 2023-12-06T07:45:16.268 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157619.log.gz 2023-12-06T07:45:16.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152030.log 2023-12-06T07:45:16.268 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145066.log.gz 2023-12-06T07:45:16.268 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124687.log 2023-12-06T07:45:16.269 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125350.log.gz 2023-12-06T07:45:16.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168435.log 2023-12-06T07:45:16.269 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152030.log.gz 2023-12-06T07:45:16.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158383.log 2023-12-06T07:45:16.269 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124687.log.gz 2023-12-06T07:45:16.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166720.log 2023-12-06T07:45:16.269 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168435.log.gz 2023-12-06T07:45:16.269 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160506.log 2023-12-06T07:45:16.269 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158383.log.gz 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123064.log 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166720.log.gz 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134961.log 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160506.log.gz 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135814.log 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.123064.log.gz 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138061.log 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134961.log.gz 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118248.log 2023-12-06T07:45:16.270 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135814.log.gz 2023-12-06T07:45:16.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152073.log 2023-12-06T07:45:16.271 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138061.log.gz 2023-12-06T07:45:16.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118248.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.118248.log.gz-- 2023-12-06T07:45:16.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153879.log 2023-12-06T07:45:16.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129997.log 2023-12-06T07:45:16.271 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152073.log.gz 2023-12-06T07:45:16.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136234.log 2023-12-06T07:45:16.271 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153879.log.gz 2023-12-06T07:45:16.271 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163128.log 2023-12-06T07:45:16.272 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129997.log.gz 2023-12-06T07:45:16.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139746.log 2023-12-06T07:45:16.272 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136234.log.gz 2023-12-06T07:45:16.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.163128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129519.log 2023-12-06T07:45:16.272 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163128.log.gz 2023-12-06T07:45:16.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150429.log 2023-12-06T07:45:16.272 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139746.log.gz 2023-12-06T07:45:16.272 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140388.log 2023-12-06T07:45:16.272 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129519.log.gz 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162091.log 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150429.log.gz 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124248.log 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140388.log.gz 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128652.log 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.162091.log.gz 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124248.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.124248.log.gz/var/log/ceph/ceph-client.admin.152395.log 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134598.log 2023-12-06T07:45:16.273 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128652.log.gz 2023-12-06T07:45:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121357.log 2023-12-06T07:45:16.274 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152395.log.gz 2023-12-06T07:45:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134598.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.150171.log 2023-12-06T07:45:16.274 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.134598.log.gz 2023-12-06T07:45:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121357.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.121357.log.gz 2023-12-06T07:45:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137283.log 2023-12-06T07:45:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150171.log.gz 2023-12-06T07:45:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130522.log 2023-12-06T07:45:16.274 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143586.log 2023-12-06T07:45:16.275 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137283.log.gz 2023-12-06T07:45:16.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169550.log 2023-12-06T07:45:16.275 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130522.log.gz 2023-12-06T07:45:16.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156333.log 2023-12-06T07:45:16.275 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143586.log.gz 2023-12-06T07:45:16.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137068.log 2023-12-06T07:45:16.275 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169550.log.gz 2023-12-06T07:45:16.275 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127596.log 2023-12-06T07:45:16.275 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156333.log.gz 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130711.log 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137068.log.gz 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122011.log 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127596.log.gz 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130711.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.149823.log 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130711.log.gz 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141334.log 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122011.log.gz 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159539.log 2023-12-06T07:45:16.276 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149823.log.gz 2023-12-06T07:45:16.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152653.log 2023-12-06T07:45:16.277 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141334.log.gz 2023-12-06T07:45:16.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135995.log 2023-12-06T07:45:16.277 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159539.log.gz 2023-12-06T07:45:16.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143715.log 2023-12-06T07:45:16.277 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152653.log.gz 2023-12-06T07:45:16.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135995.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.155470.log -- replaced with /var/log/ceph/ceph-client.admin.135995.log.gz 2023-12-06T07:45:16.277 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.277 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138276.log 2023-12-06T07:45:16.278 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143715.log.gz 2023-12-06T07:45:16.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140281.log 2023-12-06T07:45:16.278 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155470.log.gz 2023-12-06T07:45:16.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119841.log 2023-12-06T07:45:16.278 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138276.log.gz 2023-12-06T07:45:16.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127816.log 2023-12-06T07:45:16.278 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140281.log.gz 2023-12-06T07:45:16.278 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147809.log 2023-12-06T07:45:16.278 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119841.log.gz 2023-12-06T07:45:16.279 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140368.log 2023-12-06T07:45:16.279 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127816.log.gz 2023-12-06T07:45:16.279 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162461.log 2023-12-06T07:45:16.279 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147809.log.gz 2023-12-06T07:45:16.279 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168182.log 2023-12-06T07:45:16.279 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140368.log.gz 2023-12-06T07:45:16.279 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140606.log 2023-12-06T07:45:16.279 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162461.log.gz 2023-12-06T07:45:16.279 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129094.log 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168182.log.gz 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139703.log 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140606.log.gz 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133740.log 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129094.log.gz 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126756.log 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139703.log.gz 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167129.log 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133740.log.gz 2023-12-06T07:45:16.280 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154695.log 2023-12-06T07:45:16.281 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126756.log.gz 2023-12-06T07:45:16.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167129.log.gz 2023-12-06T07:45:16.281 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120531.log 2023-12-06T07:45:16.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128482.log 2023-12-06T07:45:16.281 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154695.log.gz 2023-12-06T07:45:16.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163019.log 2023-12-06T07:45:16.281 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120531.log.gz 2023-12-06T07:45:16.281 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153384.log 2023-12-06T07:45:16.281 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128482.log.gz 2023-12-06T07:45:16.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.163019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152997.log 2023-12-06T07:45:16.282 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163019.log.gz 2023-12-06T07:45:16.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150537.log 2023-12-06T07:45:16.282 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153384.log.gz 2023-12-06T07:45:16.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124925.log 2023-12-06T07:45:16.282 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152997.log.gz 2023-12-06T07:45:16.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161856.log 2023-12-06T07:45:16.282 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150537.log.gz 2023-12-06T07:45:16.282 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121412.log 2023-12-06T07:45:16.283 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124925.log.gz 2023-12-06T07:45:16.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133783.log 2023-12-06T07:45:16.283 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161856.log.gz 2023-12-06T07:45:16.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151584.log 2023-12-06T07:45:16.283 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121412.log.gz 2023-12-06T07:45:16.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132361.log 2023-12-06T07:45:16.283 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133783.log.gz 2023-12-06T07:45:16.283 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131194.log 2023-12-06T07:45:16.283 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151584.log.gz 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129145.log 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132361.log.gz 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119604.log 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.131194.log.gz 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136733.log 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129145.log.gz 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143651.log 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119604.log.gz 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155506.log 2023-12-06T07:45:16.284 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136733.log.gz 2023-12-06T07:45:16.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159324.log 2023-12-06T07:45:16.285 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143651.log.gz 2023-12-06T07:45:16.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152546.log 2023-12-06T07:45:16.285 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155506.log.gz 2023-12-06T07:45:16.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143479.log 2023-12-06T07:45:16.285 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159324.log.gz 2023-12-06T07:45:16.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128176.log 2023-12-06T07:45:16.285 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152546.log.gz 2023-12-06T07:45:16.285 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125928.log 2023-12-06T07:45:16.286 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143479.log.gz 2023-12-06T07:45:16.286 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136675.log 2023-12-06T07:45:16.286 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128176.log.gz 2023-12-06T07:45:16.286 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147228.log 2023-12-06T07:45:16.286 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125928.log.gz 2023-12-06T07:45:16.286 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155014.log 2023-12-06T07:45:16.286 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.136675.log.gz 2023-12-06T07:45:16.286 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147228.log.gz 2023-12-06T07:45:16.286 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129349.log 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140730.log 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155014.log.gz 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138618.log 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129349.log.gz 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156042.log 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140730.log.gz 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136796.log 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138618.log.gz 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144898.log 2023-12-06T07:45:16.287 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156042.log.gz 2023-12-06T07:45:16.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136939.log 2023-12-06T07:45:16.288 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136796.log.gz 2023-12-06T07:45:16.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153169.log 2023-12-06T07:45:16.288 INFO:teuthology.orchestra.run.smithi134.stderr: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.144898.log.gz 2023-12-06T07:45:16.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136939.log.gz 2023-12-06T07:45:16.288 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162869.log 2023-12-06T07:45:16.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122441.log 2023-12-06T07:45:16.288 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153169.log.gz 2023-12-06T07:45:16.288 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162805.log 2023-12-06T07:45:16.289 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162869.log.gz 2023-12-06T07:45:16.289 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133847.log 2023-12-06T07:45:16.289 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122441.log.gz 2023-12-06T07:45:16.289 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125061.log 2023-12-06T07:45:16.289 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162805.log.gz 2023-12-06T07:45:16.289 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139553.log 2023-12-06T07:45:16.289 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133847.log.gz 2023-12-06T07:45:16.289 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130564.log 2023-12-06T07:45:16.289 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125061.log.gz 2023-12-06T07:45:16.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119707.log 2023-12-06T07:45:16.290 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139553.log.gz 2023-12-06T07:45:16.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131320.log 2023-12-06T07:45:16.290 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130564.log.gz 2023-12-06T07:45:16.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135656.log 2023-12-06T07:45:16.290 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.119707.log.gz 2023-12-06T07:45:16.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151664.log 2023-12-06T07:45:16.290 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131320.log.gz 2023-12-06T07:45:16.290 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120660.log 2023-12-06T07:45:16.291 INFO:teuthology.orchestra.run.smithi134.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.135656.log.gz 2023-12-06T07:45:16.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148827.log 2023-12-06T07:45:16.291 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151664.log.gz 2023-12-06T07:45:16.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121176.log 2023-12-06T07:45:16.291 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120660.log.gz 2023-12-06T07:45:16.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127696.log 2023-12-06T07:45:16.291 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148827.log.gz 2023-12-06T07:45:16.291 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124568.log 2023-12-06T07:45:16.291 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121176.log.gz 2023-12-06T07:45:16.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129196.log 2023-12-06T07:45:16.292 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127696.log.gz 2023-12-06T07:45:16.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134360.log 2023-12-06T07:45:16.292 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124568.log.gz 2023-12-06T07:45:16.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160184.log 2023-12-06T07:45:16.292 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129196.log.gz 2023-12-06T07:45:16.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126076.log 2023-12-06T07:45:16.292 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.134360.log.gz 2023-12-06T07:45:16.292 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127956.log 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160184.log.gz 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145195.log 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126076.log.gz 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157748.log 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127956.log.gz 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145195.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.145195.log.gz/var/log/ceph/ceph-client.admin.159002.log 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131026.log 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157748.log.gz 2023-12-06T07:45:16.293 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123841.log 2023-12-06T07:45:16.294 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159002.log.gz 2023-12-06T07:45:16.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152610.log 2023-12-06T07:45:16.294 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131026.log.gz 2023-12-06T07:45:16.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123841.log.gz 2023-12-06T07:45:16.294 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153298.log 2023-12-06T07:45:16.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169648.log 2023-12-06T07:45:16.294 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152610.log.gz 2023-12-06T07:45:16.294 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127056.log 2023-12-06T07:45:16.294 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153298.log.gz 2023-12-06T07:45:16.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158444.log 2023-12-06T07:45:16.295 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169648.log.gz 2023-12-06T07:45:16.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127056.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.127056.log.gz 2023-12-06T07:45:16.295 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.133718.log 2023-12-06T07:45:16.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121733.log 2023-12-06T07:45:16.295 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158444.log.gz 2023-12-06T07:45:16.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158070.log 2023-12-06T07:45:16.295 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133718.log.gz 2023-12-06T07:45:16.295 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125469.log 2023-12-06T07:45:16.296 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121733.log.gz 2023-12-06T07:45:16.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169395.log 2023-12-06T07:45:16.296 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158070.log.gz 2023-12-06T07:45:16.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156592.log 2023-12-06T07:45:16.296 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125469.log.gz 2023-12-06T07:45:16.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145496.log 2023-12-06T07:45:16.296 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169395.log.gz 2023-12-06T07:45:16.296 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125095.log 2023-12-06T07:45:16.296 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156592.log.gz 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145496.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.145496.log.gz 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.140686.log 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145539.log 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125095.log.gz 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153535.log 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140686.log.gz 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150644.log 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145539.log.gz 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166262.log 2023-12-06T07:45:16.297 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153535.log.gz 2023-12-06T07:45:16.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140499.log 2023-12-06T07:45:16.298 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150644.log.gz 2023-12-06T07:45:16.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134679.log 2023-12-06T07:45:16.298 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166262.log.gz 2023-12-06T07:45:16.298 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153748.log 2023-12-06T07:45:16.298 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140499.log.gz 2023-12-06T07:45:16.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134679.log.gz 2023-12-06T07:45:16.299 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146598.log 2023-12-06T07:45:16.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137262.log 2023-12-06T07:45:16.299 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153748.log.gz 2023-12-06T07:45:16.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130186.log 2023-12-06T07:45:16.299 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146598.log.gz 2023-12-06T07:45:16.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119163.log 2023-12-06T07:45:16.299 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137262.log.gz 2023-12-06T07:45:16.299 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128210.log 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.130186.log.gz 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156939.log 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119163.log.gz 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154383.log 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128210.log.gz 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120257.log 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156939.log.gz 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148325.log 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154383.log.gz 2023-12-06T07:45:16.300 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124313.log 2023-12-06T07:45:16.301 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120257.log.gz 2023-12-06T07:45:16.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153596.log 2023-12-06T07:45:16.301 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148325.log.gz 2023-12-06T07:45:16.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156413.log 2023-12-06T07:45:16.301 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124313.log.gz 2023-12-06T07:45:16.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158006.log 2023-12-06T07:45:16.301 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153596.log.gz 2023-12-06T07:45:16.301 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118640.log 2023-12-06T07:45:16.301 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156413.log.gz 2023-12-06T07:45:16.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158006.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158006.log.gz 2023-12-06T07:45:16.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123366.log 2023-12-06T07:45:16.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169289.log 2023-12-06T07:45:16.302 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118640.log.gz 2023-12-06T07:45:16.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119783.log 2023-12-06T07:45:16.302 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123366.log.gz 2023-12-06T07:45:16.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160603.log 2023-12-06T07:45:16.302 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169289.log.gz 2023-12-06T07:45:16.302 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135694.log 2023-12-06T07:45:16.303 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.119783.log.gz 2023-12-06T07:45:16.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120219.log 2023-12-06T07:45:16.303 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160603.log.gz 2023-12-06T07:45:16.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168386.log 2023-12-06T07:45:16.303 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135694.log.gz 2023-12-06T07:45:16.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129892.log 2023-12-06T07:45:16.303 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120219.log.gz 2023-12-06T07:45:16.303 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168386.log.gz 2023-12-06T07:45:16.303 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150408.log 2023-12-06T07:45:16.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167227.log 2023-12-06T07:45:16.304 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129892.log.gz 2023-12-06T07:45:16.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138448.log 2023-12-06T07:45:16.304 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150408.log.gz 2023-12-06T07:45:16.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156862.log 2023-12-06T07:45:16.304 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167227.log.gz 2023-12-06T07:45:16.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139832.log 2023-12-06T07:45:16.304 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138448.log.gz 2023-12-06T07:45:16.304 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139424.log 2023-12-06T07:45:16.305 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156862.log.gz 2023-12-06T07:45:16.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142581.log 2023-12-06T07:45:16.305 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139832.log.gz 2023-12-06T07:45:16.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139959.log 2023-12-06T07:45:16.305 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139424.log.gz 2023-12-06T07:45:16.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151932.log 2023-12-06T07:45:16.305 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142581.log.gz 2023-12-06T07:45:16.305 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131551.log 2023-12-06T07:45:16.306 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139959.log.gz 2023-12-06T07:45:16.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125027.log 2023-12-06T07:45:16.306 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151932.log.gz 2023-12-06T07:45:16.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147960.log 2023-12-06T07:45:16.306 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131551.log.gz 2023-12-06T07:45:16.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136533.log 2023-12-06T07:45:16.306 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125027.log.gz 2023-12-06T07:45:16.306 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126156.log 2023-12-06T07:45:16.306 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147960.log.gz 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138904.log 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136533.log.gz 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151889.log 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126156.log.gz 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127336.log 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138904.log.gz 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162310.log 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151889.log.gz 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130102.log 2023-12-06T07:45:16.307 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127336.log.gz 2023-12-06T07:45:16.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117707.log 2023-12-06T07:45:16.308 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162310.log.gz 2023-12-06T07:45:16.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120341.log 2023-12-06T07:45:16.308 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130102.log.gz 2023-12-06T07:45:16.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119249.log 2023-12-06T07:45:16.308 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117707.log.gz 2023-12-06T07:45:16.308 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151292.log 2023-12-06T07:45:16.308 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120341.log.gz 2023-12-06T07:45:16.309 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119249.log.gz 2023-12-06T07:45:16.309 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133181.log 2023-12-06T07:45:16.309 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151292.log.gz 2023-12-06T07:45:16.309 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120201.log 2023-12-06T07:45:16.309 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154774.log 2023-12-06T07:45:16.309 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133181.log.gz 2023-12-06T07:45:16.309 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140326.log 2023-12-06T07:45:16.309 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120201.log.gz 2023-12-06T07:45:16.310 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157877.log 2023-12-06T07:45:16.310 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154774.log.gz 2023-12-06T07:45:16.310 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125860.log 2023-12-06T07:45:16.310 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140326.log.gz 2023-12-06T07:45:16.310 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148196.log 2023-12-06T07:45:16.310 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157877.log.gz 2023-12-06T07:45:16.310 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129821.log 2023-12-06T07:45:16.310 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125860.log.gz 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126096.log 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148196.log.gz 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127196.log 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129821.log.gz 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135488.log 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126096.log.gz 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136135.log 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127196.log.gz 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162132.log 2023-12-06T07:45:16.311 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135488.log.gz 2023-12-06T07:45:16.312 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140042.log 2023-12-06T07:45:16.312 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.136135.log.gz 2023-12-06T07:45:16.312 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153920.log 2023-12-06T07:45:16.312 INFO:teuthology.orchestra.run.smithi134.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.162132.log.gz 2023-12-06T07:45:16.312 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156139.log 2023-12-06T07:45:16.312 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140042.log.gz 2023-12-06T07:45:16.312 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135797.log 2023-12-06T07:45:16.312 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153920.log.gz 2023-12-06T07:45:16.312 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157726.log 2023-12-06T07:45:16.313 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156139.log.gz 2023-12-06T07:45:16.313 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166058.log 2023-12-06T07:45:16.313 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.135797.log.gz 2023-12-06T07:45:16.313 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120276.log 2023-12-06T07:45:16.313 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157726.log.gz 2023-12-06T07:45:16.313 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139768.log 2023-12-06T07:45:16.313 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166058.log.gz 2023-12-06T07:45:16.313 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135459.log 2023-12-06T07:45:16.313 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120276.log.gz 2023-12-06T07:45:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155074.log 2023-12-06T07:45:16.314 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139768.log.gz 2023-12-06T07:45:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135459.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.135459.log.gz 2023-12-06T07:45:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.146800.log 2023-12-06T07:45:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165409.log 2023-12-06T07:45:16.314 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155074.log.gz 2023-12-06T07:45:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128516.log 2023-12-06T07:45:16.314 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146800.log.gz 2023-12-06T07:45:16.314 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141829.log 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165409.log.gz 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139979.log 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128516.log.gz 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161383.log 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141829.log.gz 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132060.log 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139979.log.gz 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128567.log 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161383.log.gz 2023-12-06T07:45:16.315 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158363.log 2023-12-06T07:45:16.316 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132060.log.gz 2023-12-06T07:45:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159690.log 2023-12-06T07:45:16.316 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128567.log.gz 2023-12-06T07:45:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123755.log 2023-12-06T07:45:16.316 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158363.log.gz 2023-12-06T07:45:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143070.log 2023-12-06T07:45:16.316 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159690.log.gz 2023-12-06T07:45:16.316 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127796.log 2023-12-06T07:45:16.316 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123755.log.gz 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119185.log 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143070.log.gz 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141979.log 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127796.log.gz 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149211.log 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119185.log.gz 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139939.log 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141979.log.gz 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131846.log 2023-12-06T07:45:16.317 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149211.log.gz 2023-12-06T07:45:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169346.log 2023-12-06T07:45:16.318 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139939.log.gz 2023-12-06T07:45:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138469.log 2023-12-06T07:45:16.318 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.131846.log.gz 2023-12-06T07:45:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158918.log 2023-12-06T07:45:16.318 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169346.log.gz 2023-12-06T07:45:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164980.log 2023-12-06T07:45:16.318 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138469.log.gz 2023-12-06T07:45:16.318 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148910.log 2023-12-06T07:45:16.319 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158918.log.gz 2023-12-06T07:45:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.164980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164980.log.gz 2023-12-06T07:45:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122699.log 2023-12-06T07:45:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162525.log 2023-12-06T07:45:16.319 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148910.log.gz 2023-12-06T07:45:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125758.log 2023-12-06T07:45:16.319 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122699.log.gz 2023-12-06T07:45:16.319 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139316.log 2023-12-06T07:45:16.319 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162525.log.gz 2023-12-06T07:45:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138254.log 2023-12-06T07:45:16.320 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125758.log.gz 2023-12-06T07:45:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153613.log 2023-12-06T07:45:16.320 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139316.log.gz 2023-12-06T07:45:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149746.log 2023-12-06T07:45:16.320 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138254.log.gz 2023-12-06T07:45:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122635.log 2023-12-06T07:45:16.320 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153613.log.gz 2023-12-06T07:45:16.320 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142870.log 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149746.log.gz 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138211.log 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122635.log.gz 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119421.log 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142870.log.gz 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134520.log 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138211.log.gz 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119421.log.gz 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150993.log 2023-12-06T07:45:16.321 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161096.log 2023-12-06T07:45:16.322 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.134520.log.gz 2023-12-06T07:45:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126896.log 2023-12-06T07:45:16.322 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150993.log.gz 2023-12-06T07:45:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129655.log 2023-12-06T07:45:16.322 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161096.log.gz 2023-12-06T07:45:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134881.log 2023-12-06T07:45:16.322 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126896.log.gz 2023-12-06T07:45:16.322 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146245.log 2023-12-06T07:45:16.322 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129655.log.gz 2023-12-06T07:45:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133992.log 2023-12-06T07:45:16.323 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134881.log.gz 2023-12-06T07:45:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139488.log 2023-12-06T07:45:16.323 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146245.log.gz 2023-12-06T07:45:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160356.log 2023-12-06T07:45:16.323 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133992.log.gz 2023-12-06T07:45:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136372.log 2023-12-06T07:45:16.323 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139488.log.gz 2023-12-06T07:45:16.323 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132619.log 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160356.log.gz 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154897.log 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136372.log: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.136372.log.gz 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122592.log 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132619.log.gz 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141893.log 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154897.log.gz 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146759.log 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122592.log.gz 2023-12-06T07:45:16.324 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148575.log 2023-12-06T07:45:16.325 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141893.log.gz 2023-12-06T07:45:16.325 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119512.log 2023-12-06T07:45:16.325 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146759.log.gz 2023-12-06T07:45:16.325 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148575.log.gz 2023-12-06T07:45:16.325 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119682.log 2023-12-06T07:45:16.325 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157513.log 2023-12-06T07:45:16.325 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119512.log.gz 2023-12-06T07:45:16.325 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154362.log 2023-12-06T07:45:16.325 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119682.log.gz 2023-12-06T07:45:16.326 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134699.log 2023-12-06T07:45:16.326 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157513.log.gz 2023-12-06T07:45:16.326 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147788.log 0.0% 2023-12-06T07:45:16.326 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.154362.log.gz 2023-12-06T07:45:16.326 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130753.log 2023-12-06T07:45:16.326 INFO:teuthology.orchestra.run.smithi134.stderr: 10.2% -- replaced with /var/log/ceph/ceph-client.admin.134699.log.gz 2023-12-06T07:45:16.326 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125367.log 2023-12-06T07:45:16.326 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147788.log.gz 2023-12-06T07:45:16.327 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118798.log 2023-12-06T07:45:16.327 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130753.log.gz 2023-12-06T07:45:16.327 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125299.log 2023-12-06T07:45:16.327 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125367.log.gz 2023-12-06T07:45:16.327 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151231.log 2023-12-06T07:45:16.327 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118798.log.gz 2023-12-06T07:45:16.327 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166524.log 2023-12-06T07:45:16.327 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125299.log.gz 2023-12-06T07:45:16.327 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151231.log.gz 2023-12-06T07:45:16.328 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120897.log 2023-12-06T07:45:16.328 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135293.log 2023-12-06T07:45:16.328 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166524.log.gz 2023-12-06T07:45:16.328 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152374.log 2023-12-06T07:45:16.328 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120897.log.gz 2023-12-06T07:45:16.328 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121539.log 2023-12-06T07:45:16.328 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135293.log.gz 2023-12-06T07:45:16.328 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128533.log 2023-12-06T07:45:16.328 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152374.log.gz 2023-12-06T07:45:16.329 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125945.log 2023-12-06T07:45:16.329 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121539.log.gz 2023-12-06T07:45:16.329 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128533.log.gz 2023-12-06T07:45:16.329 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118776.log 2023-12-06T07:45:16.329 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125180.log 2023-12-06T07:45:16.329 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125945.log.gz 2023-12-06T07:45:16.329 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120875.log 2023-12-06T07:45:16.329 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118776.log.gz 2023-12-06T07:45:16.329 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160055.log 2023-12-06T07:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125180.log.gz 2023-12-06T07:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120875.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-06T07:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120875.log.gz 2023-12-06T07:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155603.log 2023-12-06T07:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160055.log.gz 2023-12-06T07:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158530.log 2023-12-06T07:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155603.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.155603.log.gz--verbose 2023-12-06T07:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.135616.log 2023-12-06T07:45:16.330 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146142.log 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158530.log.gz 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145088.log 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135616.log.gz 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167521.log 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146142.log.gz 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149469.log 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145088.log.gz 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167521.log.gz 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156121.log 2023-12-06T07:45:16.331 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142913.log 2023-12-06T07:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149469.log.gz 2023-12-06T07:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168582.log 2023-12-06T07:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156121.log.gz 2023-12-06T07:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142913.log.gz 2023-12-06T07:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142022.log 2023-12-06T07:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122678.log 2023-12-06T07:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168582.log.gz 2023-12-06T07:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142022.log.gz 2023-12-06T07:45:16.332 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150081.log 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122678.log.gz 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133895.log 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132741.log 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150081.log.gz 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169950.log 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133895.log.gz 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132741.log.gz 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169950.log.gz 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133202.log 2023-12-06T07:45:16.333 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152481.log 2023-12-06T07:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135756.log 2023-12-06T07:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133202.log.gz 2023-12-06T07:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124772.log 0.0% 2023-12-06T07:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.152481.log.gz 2023-12-06T07:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137369.log 2023-12-06T07:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135756.log.gz 2023-12-06T07:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125894.log 2023-12-06T07:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124772.log.gz 2023-12-06T07:45:16.334 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158323.log 2023-12-06T07:45:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137369.log.gz 2023-12-06T07:45:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148428.log 2023-12-06T07:45:16.335 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125894.log.gz 2023-12-06T07:45:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137649.log 2023-12-06T07:45:16.335 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158323.log.gz 2023-12-06T07:45:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129604.log 2023-12-06T07:45:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148428.log.gz 2023-12-06T07:45:16.335 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131383.log 2023-12-06T07:45:16.335 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137649.log.gz 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129955.log 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129604.log.gz 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138863.log 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131383.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.131383.log.gz 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152804.log 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.129955.log.gz 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138426.log 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138863.log.gz 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157640.log 2023-12-06T07:45:16.336 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152804.log.gz 2023-12-06T07:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159152.log 2023-12-06T07:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138426.log.gz 2023-12-06T07:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157640.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.157640.log.gz--verbose 2023-12-06T07:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.147874.log 2023-12-06T07:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139381.log 2023-12-06T07:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159152.log.gz 2023-12-06T07:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136392.log 2023-12-06T07:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147874.log.gz 2023-12-06T07:45:16.337 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139381.log.gz 2023-12-06T07:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129366.log 2023-12-06T07:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121394.log 2023-12-06T07:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136392.log.gz 2023-12-06T07:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145838.log 2023-12-06T07:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129366.log.gz 2023-12-06T07:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121394.log.gz 2023-12-06T07:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162504.log 2023-12-06T07:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165862.log 2023-12-06T07:45:16.338 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145838.log.gz 2023-12-06T07:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114485.log 2023-12-06T07:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162504.log.gz 2023-12-06T07:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139596.log 2023-12-06T07:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165862.log.gz 2023-12-06T07:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.114485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148657.log 2023-12-06T07:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114485.log.gz 2023-12-06T07:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154736.log 2023-12-06T07:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139596.log.gz 2023-12-06T07:45:16.339 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148657.log.gz 2023-12-06T07:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136214.log 2023-12-06T07:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120087.log 2023-12-06T07:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154736.log.gz 2023-12-06T07:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136214.log.gz 2023-12-06T07:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120087.log.gz 2023-12-06T07:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123043.log 2023-12-06T07:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158092.log 2023-12-06T07:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123043.log.gz 2023-12-06T07:45:16.340 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154755.log 2023-12-06T07:45:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156649.log 2023-12-06T07:45:16.341 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158092.log.gz 2023-12-06T07:45:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152739.log 2023-12-06T07:45:16.341 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154755.log.gz 2023-12-06T07:45:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156649.log.gz 2023-12-06T07:45:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121690.log 2023-12-06T07:45:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157533.log 2023-12-06T07:45:16.341 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152739.log.gz 2023-12-06T07:45:16.341 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120811.log 2023-12-06T07:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121690.log.gz 2023-12-06T07:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128788.log 2023-12-06T07:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157533.log.gz 2023-12-06T07:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118841.log 2023-12-06T07:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120811.log.gz 2023-12-06T07:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161213.log 2023-12-06T07:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128788.log.gz 2023-12-06T07:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162633.log 2023-12-06T07:45:16.342 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118841.log.gz 2023-12-06T07:45:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124959.log 2023-12-06T07:45:16.343 INFO:teuthology.orchestra.run.smithi134.stderr: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.161213.log.gz 2023-12-06T07:45:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142087.log 2023-12-06T07:45:16.343 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162633.log.gz 2023-12-06T07:45:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129230.log 2023-12-06T07:45:16.343 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124959.log.gz 2023-12-06T07:45:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142087.log.gzgzip 2023-12-06T07:45:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.150386.log 2023-12-06T07:45:16.343 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123970.log 2023-12-06T07:45:16.344 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129230.log.gz 2023-12-06T07:45:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118948.log 2023-12-06T07:45:16.344 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150386.log.gz 2023-12-06T07:45:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129553.log 0.0% 2023-12-06T07:45:16.344 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.123970.log.gz 2023-12-06T07:45:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:gzip /var/log/ceph/ceph-client.admin.118948.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.117462.log 2023-12-06T07:45:16.344 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118948.log.gz 2023-12-06T07:45:16.344 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119034.log 2023-12-06T07:45:16.344 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129553.log.gz 2023-12-06T07:45:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117462.log.gz 2023-12-06T07:45:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117903.log 2023-12-06T07:45:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118001.log 2023-12-06T07:45:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119034.log.gz 2023-12-06T07:45:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156083.log 2023-12-06T07:45:16.345 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117903.log.gz 2023-12-06T07:45:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118001.log.gz 2023-12-06T07:45:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119378.log 2023-12-06T07:45:16.345 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131635.log 2023-12-06T07:45:16.346 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156083.log.gz 2023-12-06T07:45:16.346 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121862.log 2023-12-06T07:45:16.346 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119378.log.gz 2023-12-06T07:45:16.346 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131635.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.131635.log.gz/var/log/ceph/ceph-client.admin.150795.log 2023-12-06T07:45:16.346 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.346 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155867.log 2023-12-06T07:45:16.346 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121862.log.gz 2023-12-06T07:45:16.346 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129111.log 2023-12-06T07:45:16.346 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150795.log.gz 2023-12-06T07:45:16.347 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155867.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.155867.log.gz--verbose 2023-12-06T07:45:16.347 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.132576.log 2023-12-06T07:45:16.347 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135974.log 2023-12-06T07:45:16.347 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129111.log.gz 2023-12-06T07:45:16.347 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144959.log 2023-12-06T07:45:16.347 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132576.log.gz 2023-12-06T07:45:16.347 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135974.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.131740.log -- replaced with /var/log/ceph/ceph-client.admin.135974.log.gz 2023-12-06T07:45:16.347 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.347 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148347.log 2023-12-06T07:45:16.348 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144959.log.gz 2023-12-06T07:45:16.348 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131740.log.gz 2023-12-06T07:45:16.348 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140224.log 2023-12-06T07:45:16.348 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146182.log 2023-12-06T07:45:16.348 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148347.log.gz 2023-12-06T07:45:16.348 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140224.log.gz 2023-12-06T07:45:16.348 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144443.log 2023-12-06T07:45:16.348 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139041.log 2023-12-06T07:45:16.348 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146182.log.gz 2023-12-06T07:45:16.349 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150322.log 2023-12-06T07:45:16.349 INFO:teuthology.orchestra.run.smithi134.stderr: 55.9% -- replaced with /var/log/ceph/ceph-client.admin.144443.log.gz 2023-12-06T07:45:16.349 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139041.log.gz 2023-12-06T07:45:16.349 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150322.log.gz 2023-12-06T07:45:16.349 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123195.log 2023-12-06T07:45:16.349 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148132.log 2023-12-06T07:45:16.349 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127296.log 2023-12-06T07:45:16.349 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123195.log.gz 2023-12-06T07:45:16.349 INFO:teuthology.orchestra.run.smithi134.stderr:gzip /var/log/ceph/ceph-client.admin.148132.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.135251.log 2023-12-06T07:45:16.350 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148132.log.gz 2023-12-06T07:45:16.350 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130984.log 2023-12-06T07:45:16.350 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127296.log.gz 2023-12-06T07:45:16.350 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158027.log 2023-12-06T07:45:16.350 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135251.log.gz 2023-12-06T07:45:16.350 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146948.log 2023-12-06T07:45:16.350 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130984.log.gz 2023-12-06T07:45:16.350 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164833.log 2023-12-06T07:45:16.350 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158027.log.gz 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146948.log.gz 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139725.log 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.164833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128057.log 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164833.log.gz 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141313.log 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139725.log.gz 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148680.log 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128057.log.gz 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145432.log 2023-12-06T07:45:16.351 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141313.log.gz 2023-12-06T07:45:16.352 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148680.log.gz 2023-12-06T07:45:16.352 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145432.log.gz 2023-12-06T07:45:16.352 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122398.log 2023-12-06T07:45:16.352 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130669.log 2023-12-06T07:45:16.352 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169999.log 2023-12-06T07:45:16.352 INFO:teuthology.orchestra.run.smithi134.stderr: 27.6% -- replaced with /var/log/ceph/ceph-client.admin.122398.log.gz 2023-12-06T07:45:16.352 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126356.log 2023-12-06T07:45:16.352 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130669.log.gz 2023-12-06T07:45:16.352 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142388.log 2023-12-06T07:45:16.353 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169999.log.gz 2023-12-06T07:45:16.353 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129128.log 2023-12-06T07:45:16.353 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126356.log.gz 2023-12-06T07:45:16.353 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142388.log.gz 2023-12-06T07:45:16.353 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151705.log 2023-12-06T07:45:16.353 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146927.log 2023-12-06T07:45:16.353 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129128.log.gz 2023-12-06T07:45:16.353 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144383.log 2023-12-06T07:45:16.353 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151705.log.gz 2023-12-06T07:45:16.354 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124840.log 2023-12-06T07:45:16.354 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146927.log.gz 2023-12-06T07:45:16.354 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137627.log 2023-12-06T07:45:16.354 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144383.log.gz 2023-12-06T07:45:16.354 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160120.log 2023-12-06T07:45:16.354 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124840.log.gz 2023-12-06T07:45:16.354 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137627.log.gz 2023-12-06T07:45:16.354 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119624.log 2023-12-06T07:45:16.354 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161318.log 2023-12-06T07:45:16.355 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160120.log.gz 2023-12-06T07:45:16.355 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138759.log 2023-12-06T07:45:16.355 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119624.log.gz 2023-12-06T07:45:16.355 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129213.log 2023-12-06T07:45:16.355 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161318.log.gz 2023-12-06T07:45:16.355 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126056.log 2023-12-06T07:45:16.355 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138759.log.gz 2023-12-06T07:45:16.355 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151602.log 2023-12-06T07:45:16.355 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129213.log.gz 2023-12-06T07:45:16.356 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131110.log 2023-12-06T07:45:16.356 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126056.log.gz 2023-12-06T07:45:16.356 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121292.log 2023-12-06T07:45:16.356 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151602.log.gz 2023-12-06T07:45:16.356 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136612.log 2023-12-06T07:45:16.356 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131110.log.gz 2023-12-06T07:45:16.356 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146970.log 2023-12-06T07:45:16.356 INFO:teuthology.orchestra.run.smithi134.stderr: 6.3% -- replaced with /var/log/ceph/ceph-client.admin.121292.log.gz 2023-12-06T07:45:16.356 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136575.log 2023-12-06T07:45:16.357 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136612.log.gz 2023-12-06T07:45:16.357 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119357.log 2023-12-06T07:45:16.357 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146970.log.gz 2023-12-06T07:45:16.357 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134013.log 2023-12-06T07:45:16.357 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136575.log.gz 2023-12-06T07:45:16.357 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137932.log 2023-12-06T07:45:16.357 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119357.log.gz 2023-12-06T07:45:16.357 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139024.log 2023-12-06T07:45:16.357 INFO:teuthology.orchestra.run.smithi134.stderr: 17.2% -- replaced with /var/log/ceph/ceph-client.admin.134013.log.gz 2023-12-06T07:45:16.358 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129026.log 2023-12-06T07:45:16.358 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137932.log.gz 2023-12-06T07:45:16.358 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148721.log 2023-12-06T07:45:16.358 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139024.log.gz 2023-12-06T07:45:16.358 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130942.log 2023-12-06T07:45:16.358 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129026.log.gz 2023-12-06T07:45:16.358 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155136.log 2023-12-06T07:45:16.358 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148721.log.gz 2023-12-06T07:45:16.359 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130942.log.gz 2023-12-06T07:45:16.359 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168337.log 2023-12-06T07:45:16.359 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155136.log.gz 2023-12-06T07:45:16.359 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166009.log 2023-12-06T07:45:16.359 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168337.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.168337.log.gz-5 2023-12-06T07:45:16.359 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.129536.log 2023-12-06T07:45:16.359 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165911.log 2023-12-06T07:45:16.359 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166009.log.gz 2023-12-06T07:45:16.359 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125248.log 2023-12-06T07:45:16.360 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129536.log.gz 2023-12-06T07:45:16.360 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127836.log 2023-12-06T07:45:16.360 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165911.log.gz 2023-12-06T07:45:16.360 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122334.log 2023-12-06T07:45:16.360 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125248.log.gz 2023-12-06T07:45:16.360 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123669.log 2023-12-06T07:45:16.360 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127836.log.gz 2023-12-06T07:45:16.360 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159238.log 2023-12-06T07:45:16.360 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122334.log.gz 2023-12-06T07:45:16.361 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159260.log 2023-12-06T07:45:16.361 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123669.log.gz 2023-12-06T07:45:16.361 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159238.log.gz 2023-12-06T07:45:16.361 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159260.log.gz 2023-12-06T07:45:16.361 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165764.log 2023-12-06T07:45:16.361 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152331.log 2023-12-06T07:45:16.361 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152094.log 2023-12-06T07:45:16.361 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165764.log.gz 2023-12-06T07:45:16.361 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152331.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.152331.log.gz--verbose 2023-12-06T07:45:16.362 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.160689.log 2023-12-06T07:45:16.362 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120918.log 2023-12-06T07:45:16.362 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152094.log.gz 2023-12-06T07:45:16.362 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152223.log 2023-12-06T07:45:16.362 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.160689.log.gz 2023-12-06T07:45:16.362 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120424.log 0.0% 2023-12-06T07:45:16.362 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120918.log.gz 2023-12-06T07:45:16.362 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146556.log 2023-12-06T07:45:16.362 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152223.log.gz 2023-12-06T07:45:16.363 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150687.log 2023-12-06T07:45:16.363 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120424.log.gz 2023-12-06T07:45:16.363 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146556.log.gz 2023-12-06T07:45:16.363 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144423.log 2023-12-06T07:45:16.363 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151789.log 2023-12-06T07:45:16.363 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150687.log.gz 2023-12-06T07:45:16.363 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143608.log 2023-12-06T07:45:16.363 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144423.log.gz 2023-12-06T07:45:16.363 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151789.log.gz 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128873.log 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138082.log 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143608.log.gz 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128873.log.gzgzip 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.124381.log 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121047.log 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138082.log.gz 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128108.log 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124381.log.gz 2023-12-06T07:45:16.364 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121047.log.gz 2023-12-06T07:45:16.365 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139660.log 2023-12-06T07:45:16.365 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139166.log 2023-12-06T07:45:16.365 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128108.log.gz 2023-12-06T07:45:16.365 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159217.log 2023-12-06T07:45:16.365 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139660.log.gz 2023-12-06T07:45:16.365 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139166.log.gz 2023-12-06T07:45:16.365 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130375.log 2023-12-06T07:45:16.365 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159518.log 2023-12-06T07:45:16.365 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159217.log.gz 2023-12-06T07:45:16.366 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130375.log.gz 2023-12-06T07:45:16.366 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155723.log 2023-12-06T07:45:16.366 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163126.log 2023-12-06T07:45:16.366 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159518.log.gz 2023-12-06T07:45:16.366 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146286.log 2023-12-06T07:45:16.366 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155723.log.gz 2023-12-06T07:45:16.366 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.163126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152116.log 2023-12-06T07:45:16.366 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163126.log.gz 2023-12-06T07:45:16.366 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120746.log 2023-12-06T07:45:16.367 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146286.log.gz 2023-12-06T07:45:16.367 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130963.log 2023-12-06T07:45:16.367 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152116.log.gz 2023-12-06T07:45:16.367 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120746.log.gz 2023-12-06T07:45:16.367 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153492.log 2023-12-06T07:45:16.367 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149104.log 2023-12-06T07:45:16.367 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130963.log.gz 2023-12-06T07:45:16.367 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143006.log 2023-12-06T07:45:16.367 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153492.log.gz 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129757.log 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149104.log.gz 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr:gzip /var/log/ceph/ceph-client.admin.143006.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.142683.log 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143006.log.gz 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155846.log 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129757.log.gz 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142683.log.gz 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151766.log 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159174.log 2023-12-06T07:45:16.368 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155846.log: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.155846.log.gz 2023-12-06T07:45:16.369 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160996.log 2023-12-06T07:45:16.369 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151766.log.gz 2023-12-06T07:45:16.369 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159174.log.gz 2023-12-06T07:45:16.369 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139639.log 2023-12-06T07:45:16.369 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125622.log 2023-12-06T07:45:16.369 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160996.log.gz 2023-12-06T07:45:16.369 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137498.log 2023-12-06T07:45:16.369 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139639.log.gz 2023-12-06T07:45:16.369 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118755.log 2023-12-06T07:45:16.370 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125622.log.gz 2023-12-06T07:45:16.370 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139230.log 2023-12-06T07:45:16.370 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137498.log.gz 2023-12-06T07:45:16.370 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119314.log 2023-12-06T07:45:16.370 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118755.log.gz 2023-12-06T07:45:16.370 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139230.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.139230.log.gz--verbose 2023-12-06T07:45:16.370 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.123305.log 2023-12-06T07:45:16.370 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169093.log 2023-12-06T07:45:16.370 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119314.log.gz 2023-12-06T07:45:16.371 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150343.log 2023-12-06T07:45:16.371 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123305.log.gz 2023-12-06T07:45:16.371 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169093.log.gz 2023-12-06T07:45:16.371 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128737.log 2023-12-06T07:45:16.371 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143092.log 2023-12-06T07:45:16.371 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150343.log.gz 2023-12-06T07:45:16.371 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143307.log 2023-12-06T07:45:16.371 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128737.log.gz 2023-12-06T07:45:16.371 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146618.log 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143092.log.gz 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161340.log 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143307.log.gz 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146618.log.gz 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149276.log 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135336.log 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161340.log.gz 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146203.log 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149276.log.gz 2023-12-06T07:45:16.372 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134982.log 2023-12-06T07:45:16.373 INFO:teuthology.orchestra.run.smithi134.stderr: 56.4% -- replaced with /var/log/ceph/ceph-client.admin.135336.log.gz 2023-12-06T07:45:16.373 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161404.log 2023-12-06T07:45:16.373 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146203.log.gz 2023-12-06T07:45:16.373 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119586.log 2023-12-06T07:45:16.373 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134982.log.gz 2023-12-06T07:45:16.373 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161404.log.gzgzip 2023-12-06T07:45:16.373 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.161036.log 2023-12-06T07:45:16.373 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131278.log 2023-12-06T07:45:16.373 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119586.log.gz 2023-12-06T07:45:16.374 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133460.log 2023-12-06T07:45:16.374 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161036.log.gz 2023-12-06T07:45:16.374 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131278.log.gz 2023-12-06T07:45:16.374 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145582.log 2023-12-06T07:45:16.374 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152417.log 2023-12-06T07:45:16.374 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133460.log.gz 2023-12-06T07:45:16.374 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120789.log 2023-12-06T07:45:16.374 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145582.log.gz 2023-12-06T07:45:16.374 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147357.log 2023-12-06T07:45:16.375 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152417.log.gz 2023-12-06T07:45:16.375 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119684.log 2023-12-06T07:45:16.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120789.log.gz 2023-12-06T07:45:16.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162418.log 2023-12-06T07:45:16.375 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147357.log.gz 2023-12-06T07:45:16.375 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128159.log 2023-12-06T07:45:16.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119684.log.gz 2023-12-06T07:45:16.375 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170105.log 2023-12-06T07:45:16.375 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162418.log.gz 2023-12-06T07:45:16.376 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169044.log 2023-12-06T07:45:16.376 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128159.log.gz 2023-12-06T07:45:16.376 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.170105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130228.log 2023-12-06T07:45:16.376 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170105.log.gz 2023-12-06T07:45:16.376 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158135.log 2023-12-06T07:45:16.376 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169044.log.gz 2023-12-06T07:45:16.376 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162184.log 2023-12-06T07:45:16.376 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130228.log.gz 2023-12-06T07:45:16.376 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161555.log 2023-12-06T07:45:16.377 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158135.log.gz 2023-12-06T07:45:16.377 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130165.log 2023-12-06T07:45:16.377 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162184.log.gz 2023-12-06T07:45:16.377 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132426.log 2023-12-06T07:45:16.377 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161555.log.gz 2023-12-06T07:45:16.377 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130165.log.gz 2023-12-06T07:45:16.377 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148847.log 2023-12-06T07:45:16.377 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119566.log 2023-12-06T07:45:16.377 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132426.log.gz 2023-12-06T07:45:16.378 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143522.log 2023-12-06T07:45:16.378 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148847.log.gz 2023-12-06T07:45:16.378 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159733.log 2023-12-06T07:45:16.378 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119566.log.gz 2023-12-06T07:45:16.378 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143522.log.gz 2023-12-06T07:45:16.378 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149577.log 2023-12-06T07:45:16.378 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150040.log 2023-12-06T07:45:16.378 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159733.log.gz 2023-12-06T07:45:16.378 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134095.log 2023-12-06T07:45:16.379 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149577.log.gz 2023-12-06T07:45:16.379 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123518.log 2023-12-06T07:45:16.379 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.150040.log.gz 2023-12-06T07:45:16.379 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124942.log 2023-12-06T07:45:16.379 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134095.log.gz 2023-12-06T07:45:16.379 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145131.log 2023-12-06T07:45:16.379 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123518.log.gz 2023-12-06T07:45:16.379 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140409.log 2.5% 2023-12-06T07:45:16.379 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.124942.log.gz 2023-12-06T07:45:16.381 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123819.log 2023-12-06T07:45:16.381 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145131.log.gz 2023-12-06T07:45:16.381 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150451.log 2023-12-06T07:45:16.381 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140409.log.gz 2023-12-06T07:45:16.381 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162160.log 2023-12-06T07:45:16.381 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123819.log.gz 2023-12-06T07:45:16.382 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160874.log 2023-12-06T07:45:16.382 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150451.log.gz 2023-12-06T07:45:16.382 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147529.log 2023-12-06T07:45:16.382 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162160.log.gz 2023-12-06T07:45:16.382 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146039.log 2023-12-06T07:45:16.382 INFO:teuthology.orchestra.run.smithi134.stderr: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.160874.log.gz 2023-12-06T07:45:16.382 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157336.log 2023-12-06T07:45:16.382 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147529.log.gz 2023-12-06T07:45:16.383 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148616.log 2023-12-06T07:45:16.383 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146039.log.gz 2023-12-06T07:45:16.383 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157336.log.gz 2023-12-06T07:45:16.383 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161275.log 2023-12-06T07:45:16.383 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137584.log 2023-12-06T07:45:16.383 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148616.log.gz 2023-12-06T07:45:16.383 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161275.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.129281.log 2023-12-06T07:45:16.383 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161275.log.gz 2023-12-06T07:45:16.383 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130480.log 2023-12-06T07:45:16.384 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137584.log.gz 2023-12-06T07:45:16.384 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124099.log 2023-12-06T07:45:16.384 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129281.log.gz 2023-12-06T07:45:16.384 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114075.log 2023-12-06T07:45:16.384 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130480.log.gz 2023-12-06T07:45:16.384 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152847.log 2023-12-06T07:45:16.384 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124099.log.gz 2023-12-06T07:45:16.384 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.114075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156574.log 2023-12-06T07:45:16.384 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114075.log.gz 2023-12-06T07:45:16.385 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152847.log.gz 2023-12-06T07:45:16.385 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153765.log 2023-12-06T07:45:16.385 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155907.log /var/log/ceph/ceph-client.admin.156574.log: 2023-12-06T07:45:16.385 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156574.log.gz 2023-12-06T07:45:16.385 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 /var/log/ceph/ceph-client.admin.153765.log: --verbose -- /var/log/ceph/ceph-client.admin.138635.log 2023-12-06T07:45:16.385 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153765.log.gz 2023-12-06T07:45:16.385 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128822.log 2023-12-06T07:45:16.385 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155907.log.gz 2023-12-06T07:45:16.386 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127216.log 2023-12-06T07:45:16.386 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138635.log.gz 2023-12-06T07:45:16.386 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137824.log 2023-12-06T07:45:16.386 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128822.log.gz 2023-12-06T07:45:16.386 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127216.log.gz 2023-12-06T07:45:16.386 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157705.log 2023-12-06T07:45:16.386 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153860.log 2023-12-06T07:45:16.386 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137824.log.gz 2023-12-06T07:45:16.386 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162547.log 2023-12-06T07:45:16.387 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157705.log.gz 2023-12-06T07:45:16.387 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153860.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.153860.log.gz-5 2023-12-06T07:45:16.387 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.130039.log 2023-12-06T07:45:16.387 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150061.log 2023-12-06T07:45:16.387 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162547.log.gz 2023-12-06T07:45:16.387 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137111.log 2023-12-06T07:45:16.387 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130039.log.gz 2023-12-06T07:45:16.387 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150061.log.gz 2023-12-06T07:45:16.387 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147378.log 2023-12-06T07:45:16.388 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155827.log 2023-12-06T07:45:16.388 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137111.log.gz 2023-12-06T07:45:16.388 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.147378.log: -- /var/log/ceph/ceph-client.admin.131593.log 2023-12-06T07:45:16.388 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147378.log.gz 2023-12-06T07:45:16.388 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147766.log 2023-12-06T07:45:16.388 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155827.log.gz 2023-12-06T07:45:16.388 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127236.log 2023-12-06T07:45:16.388 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131593.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.131593.log.gz 2023-12-06T07:45:16.388 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147766.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-06T07:45:16.389 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147766.log.gz 2023-12-06T07:45:16.389 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127236.log.gz 2023-12-06T07:45:16.389 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134054.log 2023-12-06T07:45:16.389 INFO:teuthology.orchestra.run.smithi134.stderr:gzip /var/log/ceph/ceph-mon.a.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.143500.log 2023-12-06T07:45:16.389 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134054.log.gz 2023-12-06T07:45:16.389 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123153.log 2023-12-06T07:45:16.389 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143500.log.gz 2023-12-06T07:45:16.389 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151388.log 2023-12-06T07:45:16.389 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145475.log 2023-12-06T07:45:16.390 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123153.log.gz 2023-12-06T07:45:16.390 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151388.log.gz 2023-12-06T07:45:16.390 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151367.log 2023-12-06T07:45:16.390 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123408.log 2023-12-06T07:45:16.390 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145475.log.gz 2023-12-06T07:45:16.390 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130795.log 2023-12-06T07:45:16.390 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151367.log.gz 2023-12-06T07:45:16.390 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119467.log 2023-12-06T07:45:16.391 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123408.log.gz 2023-12-06T07:45:16.391 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130795.log.gz 2023-12-06T07:45:16.391 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119467.log.gz 2023-12-06T07:45:16.391 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126816.log 2023-12-06T07:45:16.391 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147163.log 2023-12-06T07:45:16.391 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139467.log 2023-12-06T07:45:16.391 INFO:teuthology.orchestra.run.smithi134.stderr: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.126816.log.gz 2023-12-06T07:45:16.391 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149901.log 2023-12-06T07:45:16.391 INFO:teuthology.orchestra.run.smithi134.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.147163.log.gz 2023-12-06T07:45:16.392 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117854.log 2023-12-06T07:45:16.392 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139467.log.gz 2023-12-06T07:45:16.392 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140020.log 2023-12-06T07:45:16.392 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149901.log.gz 2023-12-06T07:45:16.392 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157812.log 2023-12-06T07:45:16.392 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117854.log.gz 2023-12-06T07:45:16.392 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148218.log 2023-12-06T07:45:16.392 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140020.log.gz 2023-12-06T07:45:16.392 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135917.log 2023-12-06T07:45:16.393 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157812.log.gz 2023-12-06T07:45:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149555.log 2023-12-06T07:45:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148218.log.gz 2023-12-06T07:45:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135917.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.135917.log.gz/var/log/ceph/ceph-client.admin.130081.log 2023-12-06T07:45:16.393 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119228.log 2023-12-06T07:45:16.393 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149555.log.gz 2023-12-06T07:45:16.393 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154852.log 2023-12-06T07:45:16.393 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130081.log.gz 2023-12-06T07:45:16.394 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126856.log 2023-12-06T07:45:16.394 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119228.log.gz 2023-12-06T07:45:16.394 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131488.log 2023-12-06T07:45:16.394 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154852.log.gz 2023-12-06T07:45:16.394 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167374.log 2023-12-06T07:45:16.394 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126856.log.gz 2023-12-06T07:45:16.394 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128839.log 2023-12-06T07:45:16.394 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131488.log.gz 2023-12-06T07:45:16.394 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163055.log 2023-12-06T07:45:16.395 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167374.log.gz 2023-12-06T07:45:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131867.log 2023-12-06T07:45:16.395 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128839.log.gz 2023-12-06T07:45:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.163055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150859.log 2023-12-06T07:45:16.395 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163055.log.gz 2023-12-06T07:45:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155094.log 2023-12-06T07:45:16.395 INFO:teuthology.orchestra.run.smithi134.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.131867.log.gz 2023-12-06T07:45:16.395 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150975.log 2023-12-06T07:45:16.395 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150859.log.gz 2023-12-06T07:45:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148975.log 2023-12-06T07:45:16.396 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155094.log.gz 2023-12-06T07:45:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159346.log 2023-12-06T07:45:16.396 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150975.log.gz 2023-12-06T07:45:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121840.log 2023-12-06T07:45:16.396 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148975.log.gz 2023-12-06T07:45:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150515.log 2023-12-06T07:45:16.396 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159346.log.gz 2023-12-06T07:45:16.396 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137133.log 2023-12-06T07:45:16.397 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121840.log.gz 2023-12-06T07:45:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150515.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.150515.log.gz-5 2023-12-06T07:45:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.157375.log 2023-12-06T07:45:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165092.log 2023-12-06T07:45:16.397 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137133.log.gz 2023-12-06T07:45:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137996.log 2023-12-06T07:45:16.397 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157375.log.gz 2023-12-06T07:45:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165092.log.gz 2023-12-06T07:45:16.397 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137996.log.gz 2023-12-06T07:45:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146779.log 2023-12-06T07:45:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139101.log 2023-12-06T07:45:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146779.log.gz 2023-12-06T07:45:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139101.log.gz 2023-12-06T07:45:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152288.log 2023-12-06T07:45:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118733.log 2023-12-06T07:45:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159088.log 2023-12-06T07:45:16.398 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152288.log.gz 2023-12-06T07:45:16.398 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118733.log.gz 2023-12-06T07:45:16.399 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159088.log.gz 2023-12-06T07:45:16.399 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151112.log 2023-12-06T07:45:16.399 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156709.log 2023-12-06T07:45:16.399 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151112.log.gz 2023-12-06T07:45:16.399 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156709.log.gz 2023-12-06T07:45:16.399 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123478.log 2023-12-06T07:45:16.399 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121518.log 2023-12-06T07:45:16.399 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140974.log 2023-12-06T07:45:16.400 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123478.log.gz 2023-12-06T07:45:16.400 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161598.log 2023-12-06T07:45:16.400 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121518.log.gz 2023-12-06T07:45:16.400 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140974.log.gz 2023-12-06T07:45:16.400 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161598.log.gz 2023-12-06T07:45:16.400 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120940.log 2023-12-06T07:45:16.400 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144938.log 2023-12-06T07:45:16.400 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156882.log 0.0% 2023-12-06T07:45:16.400 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120940.log.gz 2023-12-06T07:45:16.401 INFO:teuthology.orchestra.run.smithi134.stderr:gzip /var/log/ceph/ceph-client.admin.144938.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.157039.log 2023-12-06T07:45:16.401 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144938.log.gz 2023-12-06T07:45:16.401 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132211.log 2023-12-06T07:45:16.401 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156882.log.gz 2023-12-06T07:45:16.401 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150881.log 2023-12-06T07:45:16.401 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157039.log.gz 2023-12-06T07:45:16.401 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126336.log 2023-12-06T07:45:16.401 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132211.log.gz 2023-12-06T07:45:16.401 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160623.log 2023-12-06T07:45:16.402 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150881.log.gz 2023-12-06T07:45:16.402 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122205.log 2023-12-06T07:45:16.402 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126336.log.gz 2023-12-06T07:45:16.402 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135896.log 2023-12-06T07:45:16.402 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160623.log.gz 2023-12-06T07:45:16.402 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161016.log 2023-12-06T07:45:16.402 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122205.log.gz 2023-12-06T07:45:16.402 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143393.log 2023-12-06T07:45:16.402 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135896.log.gz 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120031.log 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161016.log.gz 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143393.log.gz 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120031.log.gz 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153668.log 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149362.log 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153668.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.162654.log 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.153668.log.gz 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149362.log.gz 2023-12-06T07:45:16.403 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162654.log.gz 2023-12-06T07:45:16.404 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160812.log 2023-12-06T07:45:16.404 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121990.log 2023-12-06T07:45:16.404 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160812.log.gz 2023-12-06T07:45:16.404 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127396.log 2023-12-06T07:45:16.404 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118669.log 2023-12-06T07:45:16.404 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121990.log.gz 2023-12-06T07:45:16.404 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127396.log.gz 2023-12-06T07:45:16.404 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140666.log 2023-12-06T07:45:16.404 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118669.log.gz 2023-12-06T07:45:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161684.log 2023-12-06T07:45:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140666.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.140666.log.gz-- 2023-12-06T07:45:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154612.log 2023-12-06T07:45:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161684.log.gz 2023-12-06T07:45:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154612.log.gz 2023-12-06T07:45:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169240.log 2023-12-06T07:45:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122291.log 2023-12-06T07:45:16.405 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151330.log 2023-12-06T07:45:16.405 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169240.log.gz 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138383.log 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122291.log.gz 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151330.log.gz 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138383.log.gz 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157219.log 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136193.log 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118052.log 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157219.log.gz 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132103.log 2023-12-06T07:45:16.406 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136193.log.gz 2023-12-06T07:45:16.407 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131236.log 2023-12-06T07:45:16.407 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118052.log.gz 2023-12-06T07:45:16.407 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132103.log.gz 2023-12-06T07:45:16.407 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131236.log.gz 2023-12-06T07:45:16.407 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142560.log 2023-12-06T07:45:16.407 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162396.log 2023-12-06T07:45:16.407 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142560.log.gz 2023-12-06T07:45:16.407 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162396.log.gz 2023-12-06T07:45:16.407 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151682.log 2023-12-06T07:45:16.408 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168280.log 2023-12-06T07:45:16.408 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151682.log.gz 2023-12-06T07:45:16.408 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168280.log.gz 2023-12-06T07:45:16.408 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121905.log 2023-12-06T07:45:16.408 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137738.log 2023-12-06T07:45:16.408 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153234.log 2023-12-06T07:45:16.408 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121905.log.gz 2023-12-06T07:45:16.408 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155256.log 2023-12-06T07:45:16.408 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137738.log.gz 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160832.log 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153234.log.gz 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155157.log 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155256.log.gz 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127136.log 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.160832.log.gz 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121754.log 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155157.log.gz 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127136.log.gz 2023-12-06T07:45:16.409 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121754.log.gz 2023-12-06T07:45:16.410 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122119.log 2023-12-06T07:45:16.410 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131152.log 2023-12-06T07:45:16.410 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122119.log.gz 2023-12-06T07:45:16.410 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131152.log.gz 2023-12-06T07:45:16.410 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136454.log 2023-12-06T07:45:16.410 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131362.log 2023-12-06T07:45:16.410 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136454.log.gz 2023-12-06T07:45:16.410 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123345.log 2023-12-06T07:45:16.411 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158672.log 2023-12-06T07:45:16.411 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131362.log.gz 2023-12-06T07:45:16.411 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123345.log.gz 2023-12-06T07:45:16.411 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154251.log 2023-12-06T07:45:16.411 INFO:teuthology.orchestra.run.smithi134.stderr:gzip /var/log/ceph/ceph-client.admin.158672.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.151621.log 2023-12-06T07:45:16.411 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158672.log.gz 2023-12-06T07:45:16.411 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161641.log 2023-12-06T07:45:16.411 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154251.log.gz 2023-12-06T07:45:16.411 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151621.log.gz 2023-12-06T07:45:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161641.log.gz 2023-12-06T07:45:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136172.log 2023-12-06T07:45:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159195.log 2023-12-06T07:45:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136172.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136172.log.gz 2023-12-06T07:45:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159195.log.gz 2023-12-06T07:45:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152589.log 2023-12-06T07:45:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141958.log 2023-12-06T07:45:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152589.log.gz 2023-12-06T07:45:16.412 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135088.log 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165568.log 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141958.log.gz 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135088.log.gz 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165568.log.gz 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140141.log 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127636.log 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140141.log: gzip -5 0.0%--verbose -- /var/log/ceph/ceph-client.admin.153212.log -- replaced with /var/log/ceph/ceph-client.admin.140141.log.gz 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167578.log 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127636.log.gz 2023-12-06T07:45:16.413 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153212.log.gz 2023-12-06T07:45:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167578.log.gz 2023-12-06T07:45:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153630.log 2023-12-06T07:45:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166769.log 2023-12-06T07:45:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153630.log.gz 2023-12-06T07:45:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166769.log.gz 2023-12-06T07:45:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132777.log 2023-12-06T07:45:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133697.log 2023-12-06T07:45:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132777.log.gz 2023-12-06T07:45:16.414 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133697.log.gz 2023-12-06T07:45:16.415 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118199.log 2023-12-06T07:45:16.415 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150752.log 2023-12-06T07:45:16.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134240.log 2023-12-06T07:45:16.415 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118199.log.gz 2023-12-06T07:45:16.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157318.log 2023-12-06T07:45:16.415 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150752.log.gz 2023-12-06T07:45:16.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134240.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134240.log.gz 2023-12-06T07:45:16.415 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157318.log.gz 2023-12-06T07:45:16.415 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152180.log 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134901.log 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152180.log.gz 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134901.log.gz 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139510.log 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150365.log 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139510.log.gz 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150365.log.gz 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141785.log 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125452.log 2023-12-06T07:45:16.416 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120362.log 2023-12-06T07:45:16.417 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141785.log.gz 2023-12-06T07:45:16.417 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139059.log 2023-12-06T07:45:16.417 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125452.log.gz 2023-12-06T07:45:16.417 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124789.log 2023-12-06T07:45:16.417 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120362.log.gz 2023-12-06T07:45:16.417 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139059.log.gz 2023-12-06T07:45:16.417 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124789.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124789.log.gz 2023-12-06T07:45:16.417 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124120.log 2023-12-06T07:45:16.417 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167023.log 2023-12-06T07:45:16.418 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124120.log.gz 2023-12-06T07:45:16.418 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146081.log 2023-12-06T07:45:16.418 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160249.log 2023-12-06T07:45:16.418 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167023.log.gz 2023-12-06T07:45:16.418 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146081.log.gz 2023-12-06T07:45:16.418 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160249.log.gz 2023-12-06T07:45:16.418 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165360.log 2023-12-06T07:45:16.418 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136313.log 2023-12-06T07:45:16.418 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122226.log 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165360.log.gz 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152782.log 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136313.log.gz 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162611.log 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122226.log.gz 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152782.log.gz 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141613.log 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132721.log 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162611.log.gz 2023-12-06T07:45:16.419 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158264.log 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141613.log.gz 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127496.log 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132721.log.gz 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147745.log 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158264.log.gz 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157855.log 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127496.log.gz 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132598.log 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147745.log.gz 2023-12-06T07:45:16.420 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157855.log.gz 2023-12-06T07:45:16.421 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132598.log.gz 2023-12-06T07:45:16.421 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156293.log 2023-12-06T07:45:16.421 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125401.log 2023-12-06T07:45:16.421 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157454.log 2023-12-06T07:45:16.421 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156293.log.gz 2023-12-06T07:45:16.421 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142065.log 2023-12-06T07:45:16.421 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125401.log.gz 2023-12-06T07:45:16.421 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154653.log 2023-12-06T07:45:16.421 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157454.log.gz 2023-12-06T07:45:16.422 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126436.log 2023-12-06T07:45:16.422 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142065.log.gz 2023-12-06T07:45:16.422 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149426.log 2023-12-06T07:45:16.422 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154653.log.gz 2023-12-06T07:45:16.422 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126436.log.gz 2023-12-06T07:45:16.422 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149426.log.gz 2023-12-06T07:45:16.422 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119686.log 2023-12-06T07:45:16.422 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168125.log 2023-12-06T07:45:16.422 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119686.log.gz 2023-12-06T07:45:16.423 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154210.log 2023-12-06T07:45:16.423 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152976.log 2023-12-06T07:45:16.423 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168125.log.gz 2023-12-06T07:45:16.423 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168484.log 2023-12-06T07:45:16.423 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154210.log.gz 2023-12-06T07:45:16.423 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146842.log 2023-12-06T07:45:16.423 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152976.log.gz 2023-12-06T07:45:16.423 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168484.log.gz 2023-12-06T07:45:16.423 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134759.log 2023-12-06T07:45:16.424 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146842.log.gz 2023-12-06T07:45:16.424 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153901.log 2023-12-06T07:45:16.424 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123991.log 2023-12-06T07:45:16.424 INFO:teuthology.orchestra.run.smithi134.stderr: 15.7% -- replaced with /var/log/ceph/ceph-client.admin.134759.log.gz 2023-12-06T07:45:16.424 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121492.log 2023-12-06T07:45:16.424 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153901.log.gz 2023-12-06T07:45:16.424 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123991.log.gz 2023-12-06T07:45:16.424 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121492.log.gz 2023-12-06T07:45:16.424 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135834.log 2023-12-06T07:45:16.425 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120854.log 2023-12-06T07:45:16.425 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135834.log.gz 2023-12-06T07:45:16.425 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157416.log 2023-12-06T07:45:16.425 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152632.log 2023-12-06T07:45:16.425 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120854.log.gz 2023-12-06T07:45:16.425 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157416.log.gz 2023-12-06T07:45:16.425 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152632.log.gz 2023-12-06T07:45:16.425 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126516.log 2023-12-06T07:45:16.425 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128278.log 2023-12-06T07:45:16.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126516.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.135315.log -- replaced with /var/log/ceph/ceph-client.admin.126516.log.gz 2023-12-06T07:45:16.426 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146885.log 2023-12-06T07:45:16.426 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128278.log.gz 2023-12-06T07:45:16.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135315.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.135315.log.gz-5 2023-12-06T07:45:16.426 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.157576.log 2023-12-06T07:45:16.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147486.log 2023-12-06T07:45:16.426 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146885.log.gz 2023-12-06T07:45:16.426 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124184.log 2023-12-06T07:45:16.427 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157576.log.gz 2023-12-06T07:45:16.427 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139617.log 2023-12-06T07:45:16.427 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147486.log.gz 2023-12-06T07:45:16.427 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125571.log 2023-12-06T07:45:16.427 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124184.log.gz 2023-12-06T07:45:16.427 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149679.log 2023-12-06T07:45:16.427 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139617.log.gz 2023-12-06T07:45:16.427 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144403.log 2023-12-06T07:45:16.427 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125571.log.gz 2023-12-06T07:45:16.428 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149679.log.gz 2023-12-06T07:45:16.428 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144403.log.gz 2023-12-06T07:45:16.428 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165458.log 2023-12-06T07:45:16.428 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117364.log 2023-12-06T07:45:16.428 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165458.log.gz 2023-12-06T07:45:16.428 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117364.log.gz 2023-12-06T07:45:16.428 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136334.log 2023-12-06T07:45:16.428 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127036.log 2023-12-06T07:45:16.428 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143371.log 2023-12-06T07:45:16.429 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.136334.log.gz 2023-12-06T07:45:16.429 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123626.log 2023-12-06T07:45:16.429 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127036.log.gz 2023-12-06T07:45:16.429 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143371.log.gz 2023-12-06T07:45:16.429 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123626.log.gz 2023-12-06T07:45:16.429 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138600.log 2023-12-06T07:45:16.429 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135595.log 2023-12-06T07:45:16.429 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138600.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.138600.log.gz/var/log/ceph/ceph-client.admin.119056.log 2023-12-06T07:45:16.429 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.430 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124227.log 2023-12-06T07:45:16.430 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.135595.log.gz 2023-12-06T07:45:16.430 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129468.log 2023-12-06T07:45:16.430 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119056.log.gz 2023-12-06T07:45:16.430 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129009.log 2023-12-06T07:45:16.430 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124227.log.gz 2023-12-06T07:45:16.430 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132798.log 2023-12-06T07:45:16.430 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129468.log.gz 2023-12-06T07:45:16.430 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147142.log 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129009.log.gz 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132798.log.gz 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147142.log.gz 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148636.log 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136554.log 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148636.log.gz 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136554.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136554.log.gz 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138494.log 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152696.log 2023-12-06T07:45:16.431 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136292.log 2023-12-06T07:45:16.432 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138494.log.gz 2023-12-06T07:45:16.432 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162246.log 2023-12-06T07:45:16.432 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152696.log.gz 2023-12-06T07:45:16.432 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136292.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.136292.log.gz 2023-12-06T07:45:16.432 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162246.log.gz 2023-12-06T07:45:16.432 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156959.log 2023-12-06T07:45:16.432 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119099.log 2023-12-06T07:45:16.432 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118150.log 2023-12-06T07:45:16.432 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156959.log.gz 2023-12-06T07:45:16.433 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119099.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-06T07:45:16.433 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119099.log.gz 2023-12-06T07:45:16.433 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168740.log 2023-12-06T07:45:16.433 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118150.log.gz 2023-12-06T07:45:16.433 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168995.log 2023-12-06T07:45:16.433 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168740.log.gz 2023-12-06T07:45:16.433 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168995.log.gz 2023-12-06T07:45:16.433 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151054.log 2023-12-06T07:45:16.433 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158938.log 2023-12-06T07:45:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151054.log.gz 2023-12-06T07:45:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158938.log.gz 2023-12-06T07:45:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134280.log 2023-12-06T07:45:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152524.log 2023-12-06T07:45:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134280.log.gz 2023-12-06T07:45:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152524.log.gz 2023-12-06T07:45:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127656.log 2023-12-06T07:45:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128016.log 2023-12-06T07:45:16.434 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127656.log.gz 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128016.log.gz 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136854.log 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155313.log 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136854.log.gz 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155313.log.gz 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147637.log 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165156.log 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147637.log.gz 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165156.log.gz 2023-12-06T07:45:16.435 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133804.log 2023-12-06T07:45:16.436 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117315.log 2023-12-06T07:45:16.436 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133804.log.gz 2023-12-06T07:45:16.436 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117315.log.gz 2023-12-06T07:45:16.436 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145668.log 2023-12-06T07:45:16.436 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143156.log 2023-12-06T07:45:16.436 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145668.log.gz 2023-12-06T07:45:16.436 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143156.log.gz 2023-12-06T07:45:16.436 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134861.log 2023-12-06T07:45:16.436 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141441.log 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134861.log.gz 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141441.log.gz 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124585.log 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160098.log 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124585.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124585.log.gz 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160098.log.gz 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120403.log 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133331.log 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120403.log.gz 2023-12-06T07:45:16.437 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133331.log.gz 2023-12-06T07:45:16.438 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155683.log 2023-12-06T07:45:16.438 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146018.log 2023-12-06T07:45:16.438 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155683.log.gz 2023-12-06T07:45:16.438 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146018.log.gz 2023-12-06T07:45:16.438 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136475.log 2023-12-06T07:45:16.438 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129913.log 2023-12-06T07:45:16.438 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136475.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.136475.log.gz 2023-12-06T07:45:16.438 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129913.log.gz 2023-12-06T07:45:16.438 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125843.log 2023-12-06T07:45:16.439 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121797.log 2023-12-06T07:45:16.439 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125843.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125843.log.gz 2023-12-06T07:45:16.439 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121797.log.gz 2023-12-06T07:45:16.439 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131530.log 2023-12-06T07:45:16.439 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163072.log 2023-12-06T07:45:16.439 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131530.log.gz 2023-12-06T07:45:16.439 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.163072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163072.log.gz 2023-12-06T07:45:16.439 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132662.log 2023-12-06T07:45:16.439 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156276.log 2023-12-06T07:45:16.440 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132662.log.gz 2023-12-06T07:45:16.440 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156276.log.gz 2023-12-06T07:45:16.440 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138492.log 2023-12-06T07:45:16.440 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138492.log.gz 2023-12-06T07:45:16.440 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134659.log 2023-12-06T07:45:16.440 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157769.log 2023-12-06T07:45:16.440 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134659.log: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.134659.log.gz 2023-12-06T07:45:16.440 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157769.log.gz 2023-12-06T07:45:16.440 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147572.log 2023-12-06T07:45:16.441 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165517.log 2023-12-06T07:45:16.441 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147572.log.gz 2023-12-06T07:45:16.441 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165517.log.gz 2023-12-06T07:45:16.441 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137412.log 2023-12-06T07:45:16.441 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131996.log 2023-12-06T07:45:16.441 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137412.log.gz 2023-12-06T07:45:16.441 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131996.log.gz 2023-12-06T07:45:16.441 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126316.log 2023-12-06T07:45:16.441 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157099.log 2023-12-06T07:45:16.442 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126316.log.gz 2023-12-06T07:45:16.442 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157099.log.gz 2023-12-06T07:45:16.442 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158113.log 2023-12-06T07:45:16.442 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119077.log 2023-12-06T07:45:16.442 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158113.log.gz 2023-12-06T07:45:16.442 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119077.log.gz 2023-12-06T07:45:16.442 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159819.log 2023-12-06T07:45:16.442 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132189.log 2023-12-06T07:45:16.534 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159819.log.gz 2023-12-06T07:45:16.535 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132189.log.gz 2023-12-06T07:45:16.535 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148764.log 2023-12-06T07:45:16.535 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125639.log 2023-12-06T07:45:16.535 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148764.log.gz 2023-12-06T07:45:16.535 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125639.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125639.log.gz 2023-12-06T07:45:16.535 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128074.log 2023-12-06T07:45:16.535 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125129.log 2023-12-06T07:45:16.535 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128074.log.gz 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125129.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125129.log.gz 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146102.log 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125809.log 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146102.log.gz 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145738.log 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125809.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125809.log.gz 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145738.log.gz 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138707.log 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145346.log 2023-12-06T07:45:16.536 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138707.log.gz 2023-12-06T07:45:16.537 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145346.log.gz 2023-12-06T07:45:16.537 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158693.log 2023-12-06T07:45:16.537 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161234.log 2023-12-06T07:45:16.537 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158693.log.gz 2023-12-06T07:45:16.537 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161234.log.gz 2023-12-06T07:45:16.537 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124398.log 2023-12-06T07:45:16.537 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157059.log 2023-12-06T07:45:16.537 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124398.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124398.log.gz 2023-12-06T07:45:16.537 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157059.log.gz 2023-12-06T07:45:16.538 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119859.log 2023-12-06T07:45:16.538 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160791.log 2023-12-06T07:45:16.538 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119859.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119859.log.gz 2023-12-06T07:45:16.538 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160791.log.gz 2023-12-06T07:45:16.538 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122785.log 2023-12-06T07:45:16.538 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154445.log 2023-12-06T07:45:16.538 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122785.log.gz 2023-12-06T07:45:16.538 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154445.log.gz 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149783.log 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133654.log 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149783.log.gz 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133654.log.gz 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159045.log 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148867.log 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159045.log.gz 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148867.log.gz 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139789.log 2023-12-06T07:45:16.539 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125418.log 2023-12-06T07:45:16.540 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139789.log.gz 2023-12-06T07:45:16.540 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125418.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125418.log.gz 2023-12-06T07:45:16.540 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129162.log 2023-12-06T07:45:16.540 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150020.log 2023-12-06T07:45:16.540 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129162.log.gz 2023-12-06T07:45:16.540 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150020.log.gz 2023-12-06T07:45:16.540 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159948.log 2023-12-06T07:45:16.540 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133568.log 2023-12-06T07:45:16.540 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159948.log.gz 2023-12-06T07:45:16.541 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133568.log.gz 2023-12-06T07:45:16.541 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147013.log 2023-12-06T07:45:16.541 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124500.log 2023-12-06T07:45:16.541 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147013.log.gz 2023-12-06T07:45:16.541 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124500.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124500.log.gz 2023-12-06T07:45:16.541 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160270.log 2023-12-06T07:45:16.541 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126716.log 2023-12-06T07:45:16.541 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160270.log.gz 2023-12-06T07:45:16.541 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126716.log.gz 2023-12-06T07:45:16.542 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119955.log 2023-12-06T07:45:16.542 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152567.log 2023-12-06T07:45:16.542 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119955.log.gz 2023-12-06T07:45:16.542 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152567.log.gz 2023-12-06T07:45:16.542 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149662.log 2023-12-06T07:45:16.542 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121069.log 2023-12-06T07:45:16.542 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147659.log 2023-12-06T07:45:16.542 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149662.log.gz 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121069.log.gz 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147659.log.gz 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129298.log 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140472.log 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129298.log.gz 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140472.log.gz 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141462.log 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142705.log 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141462.log.gz 2023-12-06T07:45:16.543 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142705.log.gz 2023-12-06T07:45:16.544 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129706.log 2023-12-06T07:45:16.544 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146739.log 2023-12-06T07:45:16.544 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129706.log.gz 2023-12-06T07:45:16.544 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146739.log.gz 2023-12-06T07:45:16.544 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149939.log 2023-12-06T07:45:16.544 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127736.log 2023-12-06T07:45:16.544 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149939.log.gz 2023-12-06T07:45:16.544 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127736.log.gz 2023-12-06T07:45:16.545 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149979.log 2023-12-06T07:45:16.545 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137846.log 2023-12-06T07:45:16.545 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149979.log: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.149979.log.gz 2023-12-06T07:45:16.545 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137846.log.gz 2023-12-06T07:45:16.545 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155985.log 2023-12-06T07:45:16.545 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136413.log 2023-12-06T07:45:16.545 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155985.log.gz 2023-12-06T07:45:16.545 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136413.log: 56.8% -- replaced with /var/log/ceph/ceph-client.admin.136413.log.gz 2023-12-06T07:45:16.545 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143350.log 2023-12-06T07:45:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158285.log 2023-12-06T07:45:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143350.log.gz 2023-12-06T07:45:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158285.log.gz 2023-12-06T07:45:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148261.log 2023-12-06T07:45:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137803.log 2023-12-06T07:45:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148261.log.gz 2023-12-06T07:45:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137803.log.gz 2023-12-06T07:45:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126556.log 2023-12-06T07:45:16.546 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143565.log 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126556.log.gz 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143565.log.gz 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157160.log 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128550.log 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157160.log.gz 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128550.log.gz 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153996.log 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146266.log 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153996.log.gz 2023-12-06T07:45:16.547 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146266.log.gz 2023-12-06T07:45:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134819.log 2023-12-06T07:45:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123497.log 2023-12-06T07:45:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134819.log.gz 2023-12-06T07:45:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123497.log.gz 2023-12-06T07:45:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156433.log 2023-12-06T07:45:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158611.log 2023-12-06T07:45:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156433.log.gz 2023-12-06T07:45:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158611.log.gz 2023-12-06T07:45:16.548 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124517.log 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130396.log 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124517.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124517.log.gz 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130396.log.gz 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127116.log 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139209.log 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127116.log.gz 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139209.log.gz 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120574.log 2023-12-06T07:45:16.549 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161791.log 2023-12-06T07:45:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158221.log 2023-12-06T07:45:16.550 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120574.log.gz 2023-12-06T07:45:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161791.log.gz 2023-12-06T07:45:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158221.log.gz 2023-12-06T07:45:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162719.log 2023-12-06T07:45:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136961.log 2023-12-06T07:45:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162719.log.gz 2023-12-06T07:45:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136961.log.gz 2023-12-06T07:45:16.550 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161469.log 2023-12-06T07:45:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135677.log 2023-12-06T07:45:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161361.log 2023-12-06T07:45:16.551 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161469.log.gz 2023-12-06T07:45:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133868.log 2023-12-06T07:45:16.551 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.135677.log.gz 2023-12-06T07:45:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161361.log.gz 2023-12-06T07:45:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133868.log.gz 2023-12-06T07:45:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124636.log 2023-12-06T07:45:16.551 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138168.log 2023-12-06T07:45:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148089.log 2023-12-06T07:45:16.552 INFO:teuthology.orchestra.run.smithi134.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124636.log.gz 2023-12-06T07:45:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135398.log 2023-12-06T07:45:16.552 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138168.log.gz 2023-12-06T07:45:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148089.log.gz 2023-12-06T07:45:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135398.log.gz 2023-12-06T07:45:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121313.log 2023-12-06T07:45:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143264.log 2023-12-06T07:45:16.552 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121313.log.gz 2023-12-06T07:45:16.553 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130354.log 2023-12-06T07:45:16.553 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143414.log 2023-12-06T07:45:16.553 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143264.log.gz 2023-12-06T07:45:16.553 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130354.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.130354.log.gz 2023-12-06T07:45:16.553 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137477.log 2023-12-06T07:45:16.553 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143414.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.133159.log -- replaced with /var/log/ceph/ceph-client.admin.143414.log.gz 2023-12-06T07:45:16.553 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.553 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139531.log 2023-12-06T07:45:16.553 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137477.log.gz 2023-12-06T07:45:16.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133159.log.gz 2023-12-06T07:45:16.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139531.log.gz 2023-12-06T07:45:16.554 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138513.log 2023-12-06T07:45:16.554 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119935.log 2023-12-06T07:45:16.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137781.log 2023-12-06T07:45:16.554 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138513.log.gz 2023-12-06T07:45:16.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127556.log 2023-12-06T07:45:16.554 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119935.log.gz 2023-12-06T07:45:16.554 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137781.log.gz 2023-12-06T07:45:16.555 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127556.log.gz 2023-12-06T07:45:16.555 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142151.log 2023-12-06T07:45:16.555 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142237.log 2023-12-06T07:45:16.555 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142151.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.142151.log.gz-5 2023-12-06T07:45:16.555 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.154192.log 2023-12-06T07:45:16.555 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121647.log 2023-12-06T07:45:16.555 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142237.log.gz 2023-12-06T07:45:16.555 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154192.log.gz 2023-12-06T07:45:16.555 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143242.log 2023-12-06T07:45:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131953.log 2023-12-06T07:45:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121647.log.gz 2023-12-06T07:45:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143242.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.143242.log.gz-5 2023-12-06T07:45:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:--verbose -- /var/log/ceph/ceph-client.admin.154521.log 2023-12-06T07:45:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130858.log 2023-12-06T07:45:16.556 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131953.log.gz 2023-12-06T07:45:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154521.log.gz 2023-12-06T07:45:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130858.log: 24.0% -- replaced with /var/log/ceph/ceph-client.admin.130858.log.gz 2023-12-06T07:45:16.556 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128907.log 2023-12-06T07:45:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117952.log 2023-12-06T07:45:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138340.log 2023-12-06T07:45:16.557 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128907.log.gz 2023-12-06T07:45:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132254.log 2023-12-06T07:45:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117952.log.gz 2023-12-06T07:45:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138340.log.gz 2023-12-06T07:45:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132254.log.gz 2023-12-06T07:45:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157394.log 2023-12-06T07:45:16.557 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117756.log 2023-12-06T07:45:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155238.log 2023-12-06T07:45:16.558 INFO:teuthology.orchestra.run.smithi134.stderr: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.157394.log.gz 2023-12-06T07:45:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 /var/log/ceph/ceph-client.admin.117756.log: --verbose -- /var/log/ceph/ceph-client.admin.146412.log 2023-12-06T07:45:16.558 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117756.log.gz 2023-12-06T07:45:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155238.log.gz 2023-12-06T07:45:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146412.log.gz 2023-12-06T07:45:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155430.log 2023-12-06T07:45:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129264.log 2023-12-06T07:45:16.558 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122549.log 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155430.log.gz 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129264.log.gz 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122549.log.gz 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156199.log 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122807.log 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141591.log 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156199.log.gz 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154632.log 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122807.log.gz 2023-12-06T07:45:16.559 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141591.log.gz 2023-12-06T07:45:16.560 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154632.log.gz 2023-12-06T07:45:16.560 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130648.log 2023-12-06T07:45:16.560 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121155.log 2023-12-06T07:45:16.560 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130648.log: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.130648.log.gz 2023-12-06T07:45:16.560 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121155.log.gz 2023-12-06T07:45:16.560 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162267.log 2023-12-06T07:45:16.560 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131698.log 2023-12-06T07:45:16.560 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162267.log.gz 2023-12-06T07:45:16.560 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131698.log.gz 2023-12-06T07:45:16.561 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136355.log 2023-12-06T07:45:16.561 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135439.log 2023-12-06T07:45:16.561 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136355.log.gz 2023-12-06T07:45:16.561 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135439.log.gz 2023-12-06T07:45:16.561 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151467.log 2023-12-06T07:45:16.561 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136115.log 2023-12-06T07:45:16.561 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151467.log: 11.6% -- replaced with /var/log/ceph/ceph-client.admin.151467.log.gz 2023-12-06T07:45:16.561 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.136115.log.gz 2023-12-06T07:45:16.561 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150940.log 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162482.log 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150940.log.gz 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162482.log.gz 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141099.log 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117266.log 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160543.log 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141099.log.gz 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120445.log 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117266.log.gz 2023-12-06T07:45:16.562 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160543.log: 12.1% -- replaced with /var/log/ceph/ceph-client.admin.160543.log.gz 2023-12-06T07:45:16.563 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120445.log.gz 2023-12-06T07:45:16.563 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159625.log 2023-12-06T07:45:16.563 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121432.log 2023-12-06T07:45:16.563 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135068.log 2023-12-06T07:45:16.563 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159625.log.gz 2023-12-06T07:45:16.563 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159281.log 2023-12-06T07:45:16.563 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121432.log.gz 2023-12-06T07:45:16.563 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135068.log.gz 2023-12-06T07:45:16.563 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159281.log.gz 2023-12-06T07:45:16.564 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151274.log 2023-12-06T07:45:16.564 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148492.log 2023-12-06T07:45:16.564 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123604.log 2023-12-06T07:45:16.564 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151274.log.gz 2023-12-06T07:45:16.564 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131404.log 2023-12-06T07:45:16.564 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148492.log.gz 2023-12-06T07:45:16.564 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123604.log.gz 2023-12-06T07:45:16.564 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131404.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.131404.log.gz 2023-12-06T07:45:16.564 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145711.log 2023-12-06T07:45:16.565 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134415.log 2023-12-06T07:45:16.565 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142173.log 2023-12-06T07:45:16.565 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145711.log.gz 2023-12-06T07:45:16.565 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126536.log 2023-12-06T07:45:16.565 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.134415.log.gz 2023-12-06T07:45:16.565 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160206.log 2023-12-06T07:45:16.565 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142173.log.gz 2023-12-06T07:45:16.565 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126536.log.gz 2023-12-06T07:45:16.565 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160206.log.gz 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154092.log 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122140.log 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154092.log.gz 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122140.log.gz 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125265.log 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135636.log 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157791.log 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125265.log.gz 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135636.log.gz 2023-12-06T07:45:16.566 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127876.log 2023-12-06T07:45:16.567 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157791.log.gz 2023-12-06T07:45:16.567 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127876.log.gz 2023-12-06T07:45:16.567 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148953.log 2023-12-06T07:45:16.567 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132447.log 2023-12-06T07:45:16.567 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126596.log 2023-12-06T07:45:16.567 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148953.log.gz 2023-12-06T07:45:16.567 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132447.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.133632.log 2023-12-06T07:45:16.567 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.132447.log.gz 2023-12-06T07:45:16.567 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126596.log.gz 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133632.log.gz 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135149.log 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119821.log 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135149.log.gz 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119821.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119821.log.gz 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166917.log 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121454.log 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166917.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.128329.log -- replaced with /var/log/ceph/ceph-client.admin.166917.log.gz 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:45:16.568 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120239.log 2023-12-06T07:45:16.569 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121454.log.gz 2023-12-06T07:45:16.569 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128329.log.gz 2023-12-06T07:45:16.569 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148784.log 2023-12-06T07:45:16.569 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137563.log 2023-12-06T07:45:16.569 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120239.log.gz 2023-12-06T07:45:16.569 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.148784.log: -- /var/log/ceph/ceph-client.admin.166622.log 2023-12-06T07:45:16.569 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148784.log.gz 2023-12-06T07:45:16.569 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137563.log.gz 2023-12-06T07:45:16.569 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133396.log 2023-12-06T07:45:16.570 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122656.log 2023-12-06T07:45:16.570 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166622.log.gz 2023-12-06T07:45:16.570 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145978.log 2023-12-06T07:45:16.570 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133396.log.gz 2023-12-06T07:45:16.570 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119642.log 2023-12-06T07:45:16.570 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122656.log.gz 2023-12-06T07:45:16.570 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142495.log 2023-12-06T07:45:16.570 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145978.log.gz 2023-12-06T07:45:16.570 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155764.log 2023-12-06T07:45:16.571 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.119642.log.gz 2023-12-06T07:45:16.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149233.log 2023-12-06T07:45:16.571 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142495.log.gz 2023-12-06T07:45:16.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155764.log.gz 2023-12-06T07:45:16.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149233.log.gz 2023-12-06T07:45:16.571 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145389.log 2023-12-06T07:45:16.571 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169599.log 2023-12-06T07:45:16.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145389.log.gz 2023-12-06T07:45:16.571 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169599.log.gz 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134499.log 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121090.log 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164931.log 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.134499.log.gz 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121231.log 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121090.log.gz 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.164931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164931.log.gz 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158403.log 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121231.log.gz 2023-12-06T07:45:16.572 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140751.log 2023-12-06T07:45:16.573 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141419.log 2023-12-06T07:45:16.573 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158403.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.158403.log.gz 2023-12-06T07:45:16.573 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140751.log.gz 2023-12-06T07:45:16.573 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133950.log 2023-12-06T07:45:16.573 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141419.log.gz 2023-12-06T07:45:16.573 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146060.log 2023-12-06T07:45:16.573 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137154.log 2023-12-06T07:45:16.573 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133950.log.gz 2023-12-06T07:45:16.573 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146060.log.gz 2023-12-06T07:45:16.574 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154974.log 2023-12-06T07:45:16.574 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137154.log.gz 2023-12-06T07:45:16.574 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125554.log 2023-12-06T07:45:16.574 INFO:teuthology.orchestra.run.smithi134.stderr:gzip /var/log/ceph/ceph-client.admin.154974.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.132817.log 2023-12-06T07:45:16.574 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154974.log.gz 2023-12-06T07:45:16.574 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125554.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.125554.log.gz 2023-12-06T07:45:16.574 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132817.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.132817.log.gz 2023-12-06T07:45:16.574 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136713.log 2023-12-06T07:45:16.574 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161447.log 2023-12-06T07:45:16.575 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136713.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.136713.log.gz-- 2023-12-06T07:45:16.575 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131446.log 2023-12-06T07:45:16.575 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135531.log 2023-12-06T07:45:16.575 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161447.log.gz 2023-12-06T07:45:16.575 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159303.log 2023-12-06T07:45:16.575 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131446.log.gz 2023-12-06T07:45:16.575 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161877.log 2023-12-06T07:45:16.575 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135531.log.gz 2023-12-06T07:45:16.575 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159303.log.gz 2023-12-06T07:45:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161877.log.gz 2023-12-06T07:45:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136813.log 2023-12-06T07:45:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132533.log 2023-12-06T07:45:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.136813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156313.log 2023-12-06T07:45:16.576 INFO:teuthology.orchestra.run.smithi134.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.136813.log.gz 2023-12-06T07:45:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142767.log 2023-12-06T07:45:16.576 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132533.log.gz 2023-12-06T07:45:16.576 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155178.log 2023-12-06T07:45:16.576 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156313.log.gz 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119206.log 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142767.log.gz 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133116.log 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155178.log.gz 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159604.log 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119206.log.gz 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154016.log 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133116.log.gz 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159604.log.gz 2023-12-06T07:45:16.577 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154016.log.gz 2023-12-06T07:45:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146640.log 2023-12-06T07:45:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148067.log 2023-12-06T07:45:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120510.log 2023-12-06T07:45:16.578 INFO:teuthology.orchestra.run.smithi134.stderr: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.146640.log.gz 2023-12-06T07:45:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148067.log: /var/log/ceph/ceph-client.admin.162697.log 2023-12-06T07:45:16.578 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148067.log.gz 2023-12-06T07:45:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120510.log.gz 2023-12-06T07:45:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153647.log 2023-12-06T07:45:16.578 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130690.log 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162697.log.gz 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153647.log.gz 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130690.log.gz 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123215.log 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148448.log 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123215.log.gz 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148448.log.gz 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137867.log 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127996.log 2023-12-06T07:45:16.579 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137867.log.gz 2023-12-06T07:45:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127996.log.gz 2023-12-06T07:45:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137025.log 2023-12-06T07:45:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147464.log 2023-12-06T07:45:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129247.log 2023-12-06T07:45:16.580 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137025.log.gz 2023-12-06T07:45:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:gzip /var/log/ceph/ceph-client.admin.147464.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.160227.log 2023-12-06T07:45:16.580 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147464.log.gz 2023-12-06T07:45:16.580 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157079.log 2023-12-06T07:45:16.580 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129247.log.gz 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160227.log.gz 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157079.log.gz 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123690.log 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121625.log 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123690.log.gz 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140430.log 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121625.log.gz 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126416.log 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142366.log 2023-12-06T07:45:16.581 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140430.log.gz 2023-12-06T07:45:16.582 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126416.log.gz 2023-12-06T07:45:16.582 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142366.log.gz 2023-12-06T07:45:16.582 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151446.log 2023-12-06T07:45:16.582 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162204.log 2023-12-06T07:45:16.582 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132297.log 2023-12-06T07:45:16.582 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151446.log.gz 2023-12-06T07:45:16.582 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162204.log: 55.1% -- replaced with /var/log/ceph/ceph-client.admin.162204.log.gz 2023-12-06T07:45:16.582 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132297.log.gz 2023-12-06T07:45:16.585 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151846.log 2023-12-06T07:45:16.585 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152202.log 2023-12-06T07:45:16.585 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128686.log 0.0% 2023-12-06T07:45:16.585 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/ceph-client.admin.151846.log.gz 2023-12-06T07:45:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152202.log.gz 2023-12-06T07:45:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128686.log.gz 2023-12-06T07:45:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130018.log 2023-12-06T07:45:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154812.log 2023-12-06T07:45:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130018.log.gz 2023-12-06T07:45:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154812.log.gz 2023-12-06T07:45:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157281.log 2023-12-06T07:45:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128036.log 2023-12-06T07:45:16.586 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157281.log.gz 2023-12-06T07:45:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128036.log.gz 2023-12-06T07:45:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118621.log 2023-12-06T07:45:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154714.log 2023-12-06T07:45:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.118621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118621.log.gz 2023-12-06T07:45:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154714.log: 57.0% -- replaced with /var/log/ceph/ceph-client.admin.154714.log.gz 2023-12-06T07:45:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153843.log 2023-12-06T07:45:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128380.log 2023-12-06T07:45:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153843.log.gz 2023-12-06T07:45:16.587 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128380.log.gz 2023-12-06T07:45:16.588 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130627.log 2023-12-06T07:45:16.588 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119727.log 2023-12-06T07:45:16.588 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121948.log 2023-12-06T07:45:16.588 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130627.log.gz 2023-12-06T07:45:16.588 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119727.log.gz 2023-12-06T07:45:16.588 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121948.log.gz 2023-12-06T07:45:16.588 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142619.log 2023-12-06T07:45:16.588 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158897.log 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142619.log.gz 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158897.log.gz 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157683.log 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138776.log 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157683.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.157683.log.gz--verbose 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr:-- /var/log/ceph/ceph-client.admin.135170.log 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142808.log 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138776.log.gz 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135170.log.gz 2023-12-06T07:45:16.589 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142808.log.gz 2023-12-06T07:45:16.590 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122076.log 2023-12-06T07:45:16.590 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129776.log 2023-12-06T07:45:16.590 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148239.log 2023-12-06T07:45:16.590 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122076.log.gz 2023-12-06T07:45:16.590 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131656.log 2023-12-06T07:45:16.590 INFO:teuthology.orchestra.run.smithi134.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.129776.log.gz 2023-12-06T07:45:16.590 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.148239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148239.log.gz 2023-12-06T07:45:16.590 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131656.log.gz 2023-12-06T07:45:16.590 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125112.log 2023-12-06T07:45:16.591 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120961.log 2023-12-06T07:45:16.591 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125112.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125112.log.gz 2023-12-06T07:45:16.591 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120961.log.gz 2023-12-06T07:45:16.591 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151093.log 2023-12-06T07:45:16.591 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159840.log 2023-12-06T07:45:16.591 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151093.log.gz 2023-12-06T07:45:16.591 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159840.log.gz 2023-12-06T07:45:16.591 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144874.log 2023-12-06T07:45:16.591 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160442.log 2023-12-06T07:45:16.592 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.144874.log: 57.1% -- replaced with /var/log/ceph/ceph-client.admin.144874.log.gz 2023-12-06T07:45:16.592 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160442.log.gz 2023-12-06T07:45:16.592 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140646.log 2023-12-06T07:45:16.592 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151642.log 2023-12-06T07:45:16.592 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155489.log 2023-12-06T07:45:16.592 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140646.log.gz 2023-12-06T07:45:16.592 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151642.log.gz 2023-12-06T07:45:16.592 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155489.log.gz 2023-12-06T07:45:16.592 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150902.log 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137760.log 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155926.log 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150902.log.gz 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166107.log 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137760.log.gz 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155926.log: 52.9% -- replaced with /var/log/ceph/ceph-client.admin.155926.log.gz 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158651.log 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166107.log.gz 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143221.log 2023-12-06T07:45:16.593 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130417.log 2023-12-06T07:45:16.594 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158651.log.gz 2023-12-06T07:45:16.594 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125911.log 2023-12-06T07:45:16.594 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143221.log.gz 2023-12-06T07:45:16.594 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125826.log 2023-12-06T07:45:16.594 INFO:teuthology.orchestra.run.smithi134.stderr: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.130417.log.gz 2023-12-06T07:45:16.594 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154230.log 2023-12-06T07:45:16.594 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125911.log.gz 2023-12-06T07:45:16.594 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145518.log 2023-12-06T07:45:16.594 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125826.log.gz 2023-12-06T07:45:16.595 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154230.log.gz 2023-12-06T07:45:16.595 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145518.log.gz 2023-12-06T07:45:16.595 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152309.log 2023-12-06T07:45:16.595 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141291.log 2023-12-06T07:45:16.595 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152309.log.gz 2023-12-06T07:45:16.595 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135047.log 2023-12-06T07:45:16.595 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133267.log 2023-12-06T07:45:16.595 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141291.log.gz 2023-12-06T07:45:16.595 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135047.log.gz 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133267.log.gz 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153406.log 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122162.log 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153406.log.gz 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122162.log.gz 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156727.log 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156555.log 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156727.log.gz 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156555.log.gz 2023-12-06T07:45:16.596 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169844.log 2023-12-06T07:45:16.597 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159432.log 2023-12-06T07:45:16.597 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169844.log.gz 2023-12-06T07:45:16.597 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159432.log.gz 2023-12-06T07:45:16.597 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160771.log 2023-12-06T07:45:16.597 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133439.log 2023-12-06T07:45:16.597 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160771.log.gz 2023-12-06T07:45:16.597 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133439.log.gz 2023-12-06T07:45:16.597 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124670.log 2023-12-06T07:45:16.597 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126656.log 2023-12-06T07:45:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124670.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124670.log.gz 2023-12-06T07:45:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126656.log.gz 2023-12-06T07:45:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135231.log 2023-12-06T07:45:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135271.log 2023-12-06T07:45:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135231.log.gz 2023-12-06T07:45:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135271.log: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.135271.log.gz 2023-12-06T07:45:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132232.log 2023-12-06T07:45:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139123.log 2023-12-06T07:45:16.598 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132232.log.gz 2023-12-06T07:45:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139123.log.gz 2023-12-06T07:45:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156785.log 2023-12-06T07:45:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132146.log 2023-12-06T07:45:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156785.log: 57.1% -- replaced with /var/log/ceph/ceph-client.admin.156785.log.gz 2023-12-06T07:45:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132146.log.gz 2023-12-06T07:45:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140833.log 2023-12-06T07:45:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123324.log 2023-12-06T07:45:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140833.log.gz 2023-12-06T07:45:16.599 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123324.log.gz 2023-12-06T07:45:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153938.log 2023-12-06T07:45:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142747.log 2023-12-06T07:45:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153938.log.gz 2023-12-06T07:45:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142747.log.gz 2023-12-06T07:45:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128363.log 2023-12-06T07:45:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154341.log 2023-12-06T07:45:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128363.log.gz 2023-12-06T07:45:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154341.log.gz 2023-12-06T07:45:16.600 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146821.log 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168631.log 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146821.log.gz 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168631.log.gz 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119680.log 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161076.log 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119680.log.gz 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161076.log.gz 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167782.log 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162112.log 2023-12-06T07:45:16.601 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167782.log.gz 2023-12-06T07:45:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162112.log.gz 2023-12-06T07:45:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124534.log 2023-12-06T07:45:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170048.log 2023-12-06T07:45:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124534.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124534.log.gz 2023-12-06T07:45:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.170048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170048.log.gz 2023-12-06T07:45:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135128.log 2023-12-06T07:45:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138405.log 2023-12-06T07:45:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135128.log.gz 2023-12-06T07:45:16.602 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138405.log.gz 2023-12-06T07:45:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131047.log 2023-12-06T07:45:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141120.log 2023-12-06T07:45:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131047.log.gz 2023-12-06T07:45:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141120.log.gz 2023-12-06T07:45:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121561.log 2023-12-06T07:45:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156902.log 2023-12-06T07:45:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121561.log.gz 2023-12-06T07:45:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156902.log.gz 2023-12-06T07:45:16.603 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141548.log 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168840.log 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141548.log.gz 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.168840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168840.log.gz 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141720.log 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159453.log 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141720.log.gz 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159453.log.gz 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146906.log 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141484.log 2023-12-06T07:45:16.604 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146906.log.gz 2023-12-06T07:45:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141484.log.gz 2023-12-06T07:45:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139999.log 2023-12-06T07:45:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137670.log 2023-12-06T07:45:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139999.log.gz 2023-12-06T07:45:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137670.log.gz 2023-12-06T07:45:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135356.log 2023-12-06T07:45:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138039.log 2023-12-06T07:45:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135356.log.gz 2023-12-06T07:45:16.605 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138039.log.gz 2023-12-06T07:45:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147271.log 2023-12-06T07:45:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160666.log 2023-12-06T07:45:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147271.log.gz 2023-12-06T07:45:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160666.log.gz 2023-12-06T07:45:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125673.log 2023-12-06T07:45:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122979.log 2023-12-06T07:45:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125673.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125673.log.gz 2023-12-06T07:45:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122979.log.gz 2023-12-06T07:45:16.606 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154304.log 2023-12-06T07:45:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159582.log 2023-12-06T07:45:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154304.log.gz 2023-12-06T07:45:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159582.log.gz 2023-12-06T07:45:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133826.log 2023-12-06T07:45:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154833.log 2023-12-06T07:45:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:gzip /var/log/ceph/ceph-client.admin.133826.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.125163.log 2023-12-06T07:45:16.607 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133826.log.gz 2023-12-06T07:45:16.607 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137889.log 2023-12-06T07:45:16.607 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154833.log.gz 2023-12-06T07:45:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125163.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125163.log.gz 2023-12-06T07:45:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137889.log.gz 2023-12-06T07:45:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131974.log 2023-12-06T07:45:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143135.log 2023-12-06T07:45:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131974.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131974.log.gz 2023-12-06T07:45:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120143.log 2023-12-06T07:45:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117658.log /var/log/ceph/ceph-client.admin.143135.log: 2023-12-06T07:45:16.608 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143135.log.gz 2023-12-06T07:45:16.608 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120143.log.gz 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117658.log.gz 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162891.log 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114310.log 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162891.log.gz 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134178.log 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126476.log 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.114310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114310.log.gz 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134178.log: 57.1% -- replaced with /var/log/ceph/ceph-client.admin.134178.log.gz 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126476.log.gz 2023-12-06T07:45:16.609 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129934.log 2023-12-06T07:45:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-06T07:45:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129934.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.129934.log.gz 2023-12-06T07:45:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.153083.log 2023-12-06T07:45:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.153083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153083.log.gz 2023-12-06T07:45:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133912.log 2023-12-06T07:45:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125741.log 2023-12-06T07:45:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133912.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.133912.log.gz 2023-12-06T07:45:16.610 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125741.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125741.log.gz 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137541.log 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145998.log 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137541.log.gz 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126696.log 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145998.log.gz 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124619.log 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126696.log.gz 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124619.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.124619.log.gz 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169142.log 2023-12-06T07:45:16.611 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137305.log 2023-12-06T07:45:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.169142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169142.log.gz 2023-12-06T07:45:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137305.log.gz 2023-12-06T07:45:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155332.log 2023-12-06T07:45:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133073.log 2023-12-06T07:45:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155332.log: 56.6% -- replaced with /var/log/ceph/ceph-client.admin.155332.log.gz 2023-12-06T07:45:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133073.log.gz 2023-12-06T07:45:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129672.log 2023-12-06T07:45:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130060.log 2023-12-06T07:45:16.612 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129672.log.gz 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130060.log.gz 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124432.log 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134540.log 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124432.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124432.log.gz 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134540.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.134540.log.gz 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123712.log 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150558.log 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123712.log.gz 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150558.log.gz 2023-12-06T07:45:16.613 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121776.log 2023-12-06T07:45:16.614 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145303.log 2023-12-06T07:45:16.614 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.121776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121776.log.gz 2023-12-06T07:45:16.614 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145303.log.gz 2023-12-06T07:45:16.614 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160012.log 2023-12-06T07:45:16.614 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167072.log 2023-12-06T07:45:16.614 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160012.log.gz 2023-12-06T07:45:16.614 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167072.log.gz 2023-12-06T07:45:16.614 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119120.log 2023-12-06T07:45:16.614 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138653.log 2023-12-06T07:45:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119120.log.gz 2023-12-06T07:45:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138653.log.gz 2023-12-06T07:45:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145324.log 2023-12-06T07:45:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117609.log 2023-12-06T07:45:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145324.log.gz 2023-12-06T07:45:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117609.log.gz 2023-12-06T07:45:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146577.log 2023-12-06T07:45:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128227.log 2023-12-06T07:45:16.615 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146577.log.gz 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128227.log.gz 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140182.log 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161426.log 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140182.log.gz 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161426.log.gz 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141915.log 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152460.log 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141915.log.gz 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151806.log 2023-12-06T07:45:16.616 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.152460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152460.log.gz 2023-12-06T07:45:16.617 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134457.log 2023-12-06T07:45:16.617 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151806.log.gz 2023-12-06T07:45:16.617 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167325.log 2023-12-06T07:45:16.617 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134457.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.134457.log.gz 2023-12-06T07:45:16.617 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156745.log 2023-12-06T07:45:16.617 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167325.log.gz 2023-12-06T07:45:16.617 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119442.log 2023-12-06T07:45:16.617 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156745.log.gz 2023-12-06T07:45:16.617 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142302.log 2023-12-06T07:45:16.618 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122484.log 2023-12-06T07:45:16.618 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119442.log.gz 2023-12-06T07:45:16.618 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142302.log.gz 2023-12-06T07:45:16.618 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122484.log.gz 2023-12-06T07:45:16.618 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130879.log 2023-12-06T07:45:16.618 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132017.log 2023-12-06T07:45:16.618 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130879.log.gz 2023-12-06T07:45:16.618 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132017.log.gz 2023-12-06T07:45:16.618 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133353.log 2023-12-06T07:45:16.619 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160077.log 2023-12-06T07:45:16.619 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133353.log.gz 2023-12-06T07:45:16.619 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160077.log.gz 2023-12-06T07:45:16.619 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122269.log 2023-12-06T07:45:16.619 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123927.log 2023-12-06T07:45:16.619 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122269.log.gz 2023-12-06T07:45:16.619 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123927.log.gz 2023-12-06T07:45:16.619 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138547.log 2023-12-06T07:45:16.619 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139402.log 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138547.log.gz 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119993.log 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139402.log.gz 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119993.log.gz 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167733.log 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124976.log 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167733.log.gz 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124976.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124976.log.gz 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131341.log 2023-12-06T07:45:16.620 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126376.log 2023-12-06T07:45:16.621 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131341.log.gz 2023-12-06T07:45:16.621 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126376.log.gz 2023-12-06T07:45:16.621 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120163.log 2023-12-06T07:45:16.621 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153427.log 2023-12-06T07:45:16.621 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120163.log.gz 2023-12-06T07:45:16.621 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153427.log.gz 2023-12-06T07:45:16.621 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126013.log 2023-12-06T07:45:16.621 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133245.log 2023-12-06T07:45:16.621 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126013.log.gz 2023-12-06T07:45:16.622 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.133245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.133245.log.gz 2023-12-06T07:45:16.622 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142345.log 2023-12-06T07:45:16.622 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156180.log 2023-12-06T07:45:16.622 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142345.log.gz 2023-12-06T07:45:16.622 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156180.log.gz 2023-12-06T07:45:16.622 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158980.log 2023-12-06T07:45:16.622 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142893.log 2023-12-06T07:45:16.622 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158980.log.gz 2023-12-06T07:45:16.622 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142893.log.gz 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127376.log 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153729.log 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127376.log.gz 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.153729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153729.log.gz 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149861.log 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156159.log 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149861.log.gz 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.156159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156159.log.gz 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167929.log 2023-12-06T07:45:16.623 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165205.log 2023-12-06T07:45:16.624 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167929.log.gz 2023-12-06T07:45:16.624 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.165205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165205.log.gz 2023-12-06T07:45:16.624 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125333.log 2023-12-06T07:45:16.624 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148406.log 2023-12-06T07:45:16.624 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120768.log 2023-12-06T07:45:16.624 INFO:teuthology.orchestra.run.smithi134.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125333.log.gz 2023-12-06T07:45:16.624 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.148406.log: -- /var/log/ceph/ceph-client.admin.147895.log 2023-12-06T07:45:16.624 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148406.log.gz 2023-12-06T07:45:16.624 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120768.log.gz 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124466.log 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.147895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147895.log.gz 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145690.log 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124466.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124466.log.gz 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145690.log.gz 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134398.log 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123948.log 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134398.log.gz 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.123948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123948.log.gz 2023-12-06T07:45:16.625 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126396.log 2023-12-06T07:45:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159969.log 2023-12-06T07:45:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126396.log.gz 2023-12-06T07:45:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159969.log.gz 2023-12-06T07:45:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132971.log 2023-12-06T07:45:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146452.log 2023-12-06T07:45:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.132971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.132971.log.gz 2023-12-06T07:45:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146452.log.gz 2023-12-06T07:45:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131005.log 2023-12-06T07:45:16.626 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161512.log 2023-12-06T07:45:16.627 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131005.log.gz 2023-12-06T07:45:16.627 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157200.log 2023-12-06T07:45:16.627 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161512.log.gz 2023-12-06T07:45:16.627 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143049.log 2023-12-06T07:45:16.627 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157200.log.gz 2023-12-06T07:45:16.627 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.143049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143049.log.gz 2023-12-06T07:45:16.627 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157179.log 2023-12-06T07:45:16.627 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134381.log 2023-12-06T07:45:16.627 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157179.log: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.157179.log.gz 2023-12-06T07:45:16.628 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134381.log.gz 2023-12-06T07:45:16.628 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138793.log 2023-12-06T07:45:16.628 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128601.log 2023-12-06T07:45:16.628 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138793.log.gz 2023-12-06T07:45:16.628 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128601.log.gz 2023-12-06T07:45:16.628 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124738.log 2023-12-06T07:45:16.628 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138496.log 2023-12-06T07:45:16.628 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.124738.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.124738.log.gz 2023-12-06T07:45:16.628 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138496.log.gz 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137910.log 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119271.log 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137910.log.gz 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119271.log.gz 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120181.log 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167676.log 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120181.log.gz 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.167676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167676.log.gz 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157554.log 2023-12-06T07:45:16.629 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134340.log 2023-12-06T07:45:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.157554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157554.log.gz 2023-12-06T07:45:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.134340.log: 17.8% -- replaced with /var/log/ceph/ceph-client.admin.134340.log.gz 2023-12-06T07:45:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162934.log 2023-12-06T07:45:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125282.log 2023-12-06T07:45:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162934.log.gz 2023-12-06T07:45:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.125282.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.125282.log.gz 2023-12-06T07:45:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159496.log 2023-12-06T07:45:16.630 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142474.log 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.159496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159496.log.gz 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142474.log.gz 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162353.log 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128618.log 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.162353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162353.log.gz 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128618.log.gz 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145778.log 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122742.log 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145778.log.gz 2023-12-06T07:45:16.631 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.122742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122742.log.gz 2023-12-06T07:45:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141570.log 2023-12-06T07:45:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131089.log 2023-12-06T07:45:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.141570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141570.log.gz 2023-12-06T07:45:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131089.log.gz 2023-12-06T07:45:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139273.log 2023-12-06T07:45:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146516.log 2023-12-06T07:45:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139273.log.gz 2023-12-06T07:45:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.146516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146516.log.gz 2023-12-06T07:45:16.632 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155292.log 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129587.log 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155292.log.gz 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129587.log.gz 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119013.log 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151033.log 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.119013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.119013.log.gz 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151033.log.gz 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166156.log 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140451.log 2023-12-06T07:45:16.633 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166156.log.gz 2023-12-06T07:45:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140451.log.gz 2023-12-06T07:45:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155806.log 2023-12-06T07:45:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149620.log 2023-12-06T07:45:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155806.log.gz 2023-12-06T07:45:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149620.log.gz 2023-12-06T07:45:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142044.log 2023-12-06T07:45:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138362.log 2023-12-06T07:45:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.142044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142044.log.gz 2023-12-06T07:45:16.634 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138362.log.gz 2023-12-06T07:45:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154423.log 2023-12-06T07:45:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149254.log 2023-12-06T07:45:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154423.log: 57.2% -- replaced with /var/log/ceph/ceph-client.admin.154423.log.gz 2023-12-06T07:45:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149254.log.gz 2023-12-06T07:45:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120832.log 2023-12-06T07:45:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155373.log 2023-12-06T07:45:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.120832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.120832.log.gz 2023-12-06T07:45:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.155373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155373.log.gz 2023-12-06T07:45:16.635 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138564.log 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138190.log 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138564.log.gz 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138190.log.gz 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117148.log 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131677.log 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.117148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117148.log.gz 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.131677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.131677.log.gz 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161920.log 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128924.log 2023-12-06T07:45:16.636 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.161920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161920.log.gz 2023-12-06T07:45:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128924.log.gz 2023-12-06T07:45:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126876.log 2023-12-06T07:45:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130249.log 2023-12-06T07:45:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126876.log.gz 2023-12-06T07:45:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130249.log.gz 2023-12-06T07:45:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137975.log 2023-12-06T07:45:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130291.log 2023-12-06T07:45:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.137975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.137975.log.gz 2023-12-06T07:45:16.637 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130291.log: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.130291.log.gz 2023-12-06T07:45:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154937.log 2023-12-06T07:45:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130900.log 2023-12-06T07:45:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.154937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154937.log.gz 2023-12-06T07:45:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.130900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130900.log.gz 2023-12-06T07:45:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126256.log 2023-12-06T07:45:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166368.log 2023-12-06T07:45:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.126256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126256.log.gz 2023-12-06T07:45:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.166368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166368.log.gz 2023-12-06T07:45:16.638 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145045.log 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135714.log 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.145045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145045.log.gz 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.135714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135714.log.gz 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140103.log 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127416.log 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.140103.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.140103.log.gz 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.127416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127416.log.gz 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129800.log 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150838.log 2023-12-06T07:45:16.639 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.129800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129800.log.gz 2023-12-06T07:45:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150838.log.gz 2023-12-06T07:45:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158178.log 2023-12-06T07:45:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160643.log 2023-12-06T07:45:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.158178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158178.log.gz 2023-12-06T07:45:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.160643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160643.log.gz 2023-12-06T07:45:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139252.log 2023-12-06T07:45:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138810.log 2023-12-06T07:45:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139252.log.gz 2023-12-06T07:45:16.640 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.138810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.138810.log.gz 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151523.log 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150122.log 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.151523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151523.log.gz 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150122.log.gz 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149319.log 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150150.log 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.149319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149319.log.gz 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.150150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150150.log.gz 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128431.log 2023-12-06T07:45:16.641 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139144.log 2023-12-06T07:45:16.642 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.128431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128431.log.gz 2023-12-06T07:45:16.642 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.139144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.139144.log.gz 2023-12-06T07:45:16.775 INFO:teuthology.orchestra.run.smithi134.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-06T07:45:18.320 INFO:teuthology.orchestra.run.smithi134.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-06T07:45:20.382 INFO:teuthology.orchestra.run.smithi134.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-06T07:46:00.862 INFO:teuthology.orchestra.run.smithi134.stderr: 97.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-06T07:46:12.170 INFO:teuthology.orchestra.run.smithi134.stderr: 97.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-06T07:46:12.172 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-12-06T07:46:12.172 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m56.636s 2023-12-06T07:46:12.172 INFO:teuthology.orchestra.run.smithi134.stderr:user 1m45.068s 2023-12-06T07:46:12.173 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m5.405s 2023-12-06T07:46:12.173 INFO:tasks.ceph:Archiving logs... 2023-12-06T07:46:12.173 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760/remote/smithi134/log 2023-12-06T07:46:12.174 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-06T07:46:23.158 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-12-06T07:46:23.160 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-06T07:46:23.177 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-12-06T07:46:23.179 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-06T07:46:23.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-06T07:46:23.242 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-06T07:46:23.251 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-06T07:46:23.251 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-06T07:46:23.272 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2023-12-06T07:46:23.276 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-06T07:46:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2023-12-06T07:46:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 117 +1119us[+1119us] +/- 92ms 2023-12-06T07:46:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 7 377 126 -864us[ -869us] +/- 71ms 2023-12-06T07:46:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +46us[ +46us] +/- 82ms 2023-12-06T07:46:23.277 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-12-06T07:46:23.277 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-06T07:46:23.287 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-06T07:46:23.287 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-06T07:46:23.296 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-06T07:46:23.414 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-06T07:46:23.446 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T07:46:23.447 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-06T07:46:23.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-06T07:46:23.491 INFO:teuthology.task.internal:Duration was 13007.453470 seconds 2023-12-06T07:46:23.492 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-06T07:46:23.503 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-06T07:46:23.503 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-06T07:46:23.549 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-06T07:46:23.811 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-06T07:46:23.811 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2023-12-06T07:46:23.811 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-06T07:46:23.834 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-06T07:46:23.834 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-06T07:46:23.913 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-06T07:46:23.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-06T07:46:24.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-06T07:46:24.034 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-06T07:46:24.034 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-06T07:46:24.061 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-06T07:46:24.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-06T07:46:24.127 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2023-12-06T07:46:24.314 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-06T07:46:24.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T07:46:24.373 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-06T07:46:24.383 INFO:teuthology.task.internal:Transferring archived files... 2023-12-06T07:46:24.385 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760/remote/smithi134 2023-12-06T07:46:24.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-06T07:46:24.450 INFO:teuthology.task.internal:Removing archive directory... 2023-12-06T07:46:24.451 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-06T07:46:24.503 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-06T07:46:24.513 INFO:teuthology.task.internal:Not uploading archives. 2023-12-06T07:46:24.514 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-06T07:46:24.523 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-06T07:46:24.524 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-06T07:46:24.560 INFO:teuthology.orchestra.run.smithi134.stdout: 525734 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Dec 6 07:46 /home/ubuntu/cephtest 2023-12-06T07:46:24.561 INFO:teuthology.orchestra.run.smithi134.stdout: 920537 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Dec 6 04:21 /home/ubuntu/cephtest/mnt.0 2023-12-06T07:46:24.561 INFO:teuthology.orchestra.run.smithi134.stdout: 920538 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Dec 6 04:22 /home/ubuntu/cephtest/mnt.0/client.0 2023-12-06T07:46:24.561 INFO:teuthology.orchestra.run.smithi134.stdout: 920579 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Dec 6 04:22 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-12-06T07:46:24.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-06T07:46:24.562 INFO:teuthology.orchestra.run.smithi134.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-12-06T07:46:24.562 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/ceph.py", line 1917, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_d03fca4f35d43f61b4679936aef7bd2f01cced0b/qa/tasks/ceph.py", line 1312, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_f2de108beb0a6dde7f3e6c96039071828a1f6269/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi134 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-12-06T07:46:24.574 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-06T07:46:24.584 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-06T07:46:24.595 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-12-06T07:46:24.595 INFO:teuthology.nuke:Checking targets against current locks 2023-12-06T07:46:24.627 DEBUG:teuthology.nuke:shortname: smithi134 2023-12-06T07:46:24.627 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-06T07:46:24.651 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-05_19:07:37-rbd-wip-yuri6-testing-2023-12-05-0753-pacific-distro-default-smithi/7478760', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-06 04:01:34.928556', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDcXsvfoj5PjdLWsLsc9l3R4Vo1sdCldN2FJevu7vlm3NZHmL6gJKaKcOLpsRwHkAVrWc6jxrP5Lv18HimfL0/I='} 2023-12-06T07:46:24.702 INFO:teuthology.orchestra.console.smithi134:Power off 2023-12-06T07:46:24.703 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-06T07:46:24.726 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-12-06T07:46:24.727 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T07:46:24.755 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-06T07:46:28.756 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T07:46:28.866 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-12-06T07:46:32.871 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-06T07:46:32.982 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-12-06T07:46:33.082 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-12-06T07:46:33.188 INFO:teuthology.run:Summary data: description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{centos_8} workloads/rbd_cli_generic} duration: 13007.453470230103 failure_reason: 'Command failed (workunit test rbd/cli_generic.sh) on smithi134 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d03fca4f35d43f61b4679936aef7bd2f01cced0b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a409c80a42b94c2bad588f250cd3b030 status: fail success: false 2023-12-06T07:46:33.189 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-06T07:46:33.259 INFO:teuthology.run:FAIL